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GOAL I 

Goal: As a result of state network implementation by the 
New Careers in Education Office, first and" second 
^oSif^-f meeting minimum IGE imple- 

"^^^ produce significant changes 
m student learnnng. 

Objective 1.1 In comparison with children ^In control groups, 
students in IGE classrooms will show significantly 
hi t tl ^^^^^y^'"!"* ^" reading and/or math as measured 
mlti k"" ^^"^ achievement test. (Reading and/or 

math will, be measured-as appropriate to- the imp le^ ' 
°o P^°°fss in the specific schools in the 
^JoniParisons, using a t-test at a 0.05 level 
L?;^ ^^^^ ^® "i^'^e between test scores of 

Spn control groups and test, scores of child- 

ren in IGE settings.) 

Evaluation procedures ; 

Within the New Jersey Individually Guided Educat ion/Mult iunit 
School Component (IGE/MUS-E) network there are 52 schools ( 19 
first cycle and 33 second cycle) which meet the IGE/MUS-E minimum 
implementation criteria: multiunit components, a functioning 
Instructional Improvement Committee and implementation of the 
IGE process in at least one curruculum area. 

For this study, a stratified two-stage random sampling 
procedure was undertaken to identify the IGE schools to be 
included i^n the study and Jjo identify the students within each 
of these IGE schools to be tested. Of the 52 iqe schools meeting 
minimum implementation criteria, 33 schools which are proportion- 
ately representative of the four New Jersey IGE leagues (Central, 
South, Northwest, and Northeas, ) were randomly selected to 
participate in this study. 
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All IGE schools which had been identified as participating 
in the 1973-197^ evaluation study were contacted by letter, explain- 
ing the evaluation procedures. At that time, the testing procedures 
and testing times were outlined. It was also requested that the 
respective principals submit to RETE a roster of students in 
their school meeting specified age/grade requirements, a list 
of dates when testing could not take place in their schools, and 
a time schedule indicating school hours, lunch times, special 
classes, et cetera. 

Control schools which had participated in the 1972-1973 
IGE/MUS^E evaluation were again asked to participate in the 1973- 
197^1 IGE evaluation. For those IGE schools in the sample that 
did not have a carry-over control school, all attempts were 
made to match a new control school as closely as possible to 
the IGE schools in question on the following criteria: student 
enrollment, staff size, grade levels included and equalized 
valuation of the community. These same criteria for control 
school matching were employed in the 5L972-1973 evaluation design. 

Once contact had been established between RETE and the 
control schools ascertaining their agreement to participate in 
the study, a follow-up letter was mailed, outlining the focus 
of the evaluation procedures that would be employed by RETE. 

It was determined by the New Careers in Education Office 
and by RETE that the target population of the student testing 
Should be students between the ages of eight and ten who were 
JjL their second or third year of school beyond kindergarten. 
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These students were selected at random from the school 
rosters' provided. Listed below is the rationale for selection 
of the designated age/grade level: 

^' middle range of age distribution 

b. tests for younger students are not as reliable 

c. Hth graders were included in the 1973-197l< 
New Jersey Educational Assessment Program and 
should not be tested again 

d. this age range grouping is found in many IGE 

evidenced by the 1973-1974 Pertinent 
Data Bulletin. 

0 

The target sample was determined to be 385 students from 
the 33 IGE schools in the sample and 385 students from the 33 
matched control schools in the sample. The IGE sample of 
students was proportionately allocated to schools based on total 
number of students in that age range per IGE League. 

Class rosters were requested of the IGE schools for she 
specified age range. The appropriate number os students to be 
tested from that school were then randomly identified from that 
school. Three alternate names were also randomly drawn to serve 
as back-ups if the designated students should be absent during 
the time of testing. 

For the control schools, procedures were outlined by which 
designated RETE personnel would randomly select the appropriate 
Tiumber of second graders and third graders at the time of testing, 
the number of second and third graders being dependent on the 
number of those respective students in the IGE sample. 

Appropriate batteries of the 1.973 Stanford Achievement Test 
(Primary Level II) to measure cognitive outcomes were chosen. 
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The Stanford Achievement Test (Primary Level II) was selected 
because : 

a. an appropriate battery existed for testine; grade 
levels two and three 

^ b. at all levels through Intermediate II, the vocabulary 
test is dictated by, the teacher and therefore tests 
ability ^"^'^ vocabulary independent of reading 

c. in the language arti~area of reading and listening, 
the content has been chosen to be appropriate for 
children from urban, suburban, rural, and inner- 
city schools. (The paragraphs have a broad spectrum 
of appeal. ) 

d. the content of the mathematics and language tests is 
designed to meet the latfest curriculum trends in 
these subject areas 

d. the Stanford edition used was the new 1973 edTtio^ 
thus reducing an element of student test wiseness 

f. an attempt was made to reduce test bias in the norm- 
ing process.^ 

The IGE schools were implementing the IGE process in 
language ares and/or mathematics. For this reason the IGE sample 
of schools was partitioned Into two groups for testing. One 
group of schools would use appropriate language arts batteries 
and one group of IGE schools would use appropriate" mathematics 
batteries of the Stanford Achievement Test. 

The following batteries of the Stanford Achievement Tests 
(primary Level II) were chosen: 

Type 

Language Arts Vocabulary 

Reading Comprehension 
(Part A and Part B) 



Mathematics Concepts 

Computation 



Items 


Time 


37 


20 


93 


^15 


35 


20 


37 


.,30 
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The original IGE evaluation design specified that RETE 
personnel would be responsible for all test administration in 
the cognitive and affective domains. In all testing sites 
^across the state the students in both the IGE and the control 
groups were to be tested in February, 1974 to allow for sufficient 
exposure to the IGE/non-IGE experience. Intervening variables 
caused by the energy crisis and the extremely short allp'cations 
of gas in the North Jersey area prevented full implementation 
of the design by RETE personnel. With the agreement of the New 
Careers in Education Office, it was decided that the principal 
of each school would be asked to identify a test administrator 
In his/her school ti administer the appropriate batteries of the 
Stanford Achievement Tests to the studentpample. 

Contacts were made with the IGE schools and the non-IGE 
schools by RETE personnel and procedures for the mailing, 
handling, and administration of the Stanford Achievement Testi 
were supplied. An identified sample of students to be tested 
was provided for IGE schools. = Non-IGE schools were given guide- 
lines for random sampling and a table of random numbers. Test 
packets were mailed out to the respective schools with appropriate 
Information regarding testing procedures and testing times. (See 
Appendix A.) Log sheets and feedback sheets were also enclosed 
in order to elicit data as to how and when testing was carried 
out and under what conditions. Test materials were logged upon 
return by the schools. 
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A total of thirty IGE and 23 control schools returned the 
materials and participated in the evaluation. Although ten 
other control schools had indicated that they would participate ' 
in the testing, they in fact did not implement the testing. These 
data are recorded in the RETE-IGE log book. The schools who 
participated in the study are presented on the following pages 
along with a breakdown of the number of students who participated 
in the testing. 
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Participating Schools - 

Reading 

IGE 

Pairmount Ave. School, Chatham 

H.M. Davis School, River Edge 

Lincoln School", Caldwell 

P.S. #27, Paterson 

Pairview School, Red Bank 

Court St. School, Freehold 

Lavallette School, Lavallette 

H.L. Bonsall School 

Center City Catholic, Camden 

Lincoln Ave. School, Orange 

Marie V. Duffy School, Wharton 

Green Township School, Greendell 

Smalley School, Bound Brook 

So. Main Street School, Pleasant ville 

Monument School, Trenton 



IGE Evaluation Design 

Control 
Lincoln School, Dumont 
Roosevelt School, River Edge 

P.S. #7, Paterson 
River Plaza, Red Bank 
Morgahville School, Red Bank 
Island Heights Elem., Island Hts. 

Holy Name School, North Camden 
Lincoln School, East Orange 
Riverview School, Denville 
Hamburg Elementary School, Hamburg 
La Monte School, Bound Brook 
North Main St. School, Pleasant vill 



.Northwest league - ^ schools 
Northeast league - h schools 
Central league - H schools 
Southern league - 3 schools 



chools Im plement Inp; Mathematics 
IGE 

Igh Bridge Elementary, High Bridge 

locktown Rd. School, Long Valley 

ollins School, Llvlngstom 

lidd School, North Brunswick 

emorial School, Union Beach 

ur Lady star of the Sea, Cape May 

aude Wilkins School, Maple Shade 

rving Schools Highland Park 

ma C. Scott School, Leonia 

Jrriam Ave. School, Newton 

irlon Emmons McKeown School, Newton 

irray A. Chittick School, East Brunswick 

lenwood School, Wall Twp. 

erfleld School, Linden 

hn Penwick School, Salem City 



Control 

Franklin Elementary, Franklin 
Old Farmers Rd. School, Long Valley 
Riker Hill School, Long Valley 
John Adams School, North Brunswick 

St. Raymond's School, Villas 
School #4, Maple Shade 
Lafayette School, Highland Park 

Halsted St. School, Newton 
Stillwater Elem. School, Stillwater 
Memorial School, East Brunswick 
Herbert svllle School, Herbert svllle 



i 



Northwest league - 
Northeast league - 
Central league 
Southern league - 



4 schools 
3 schools 

5 schools 
3 schools 
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Evaluation findings 

Data from three of the language arts batteries ' 
Stanford Achievement Test are presented In tables 1- *J III. 
Data reflect the number correct and may be compared with norm 
tables, located In the appendix. 

A comparison of the pairs of schools (IGE/control) In 
vocabulary show eight Instances In which the mean scores of 
the control schools were slightly higher and four In which IGE 
means exceeded. Pairs of mean scores on Heading/Part A (which 
ineasures ability to read words that are generally In the average 
child *s speaking and listening vocabulary and Is essentially 
a decoding test ) shows six comparisons favoring control and 
six favoring IGE. The Reading/Part B Battery (which measures 
pupils ♦ ability to recall and Identify facts stated^Sthe text 
of very simple paragraphs) shows nine comparisons In favor of 
IGE and three In favor of the control schools. . 

Statistical comparison of overall mean scores (t-trest/at 
a 0.05 level of significance) show no significant dlffe^A^nces. 
These findings are presented in table VI. 

Data from math batteries of the Stanford Achievement Test 
are presented In tables IV & V. Comparisons of mean scores In 
math concepts Indicates that In seven of the pairs, (IGE/control) 
differences -were In favor of IGE schools and In four pairs 
the mean score of the control school was greater. Comparisons 
on math computation show five In favor of IGE and six for the 
control. . . . ; 
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Statis . ■■. comparisons (t-test at a 0.05 level of significance) 
were made between the mean score of IGF. and non-IGE schools for 
math concepts, math compuatation and for a composite of the two. 
As indicated In table 71 statistically significant differences 
were found in all three tests, with the differences favoring 
the control schools. Thus, although a greater number of IGE 
schools scored higher than their respective control schools, 

comparisons in which the magnitude of difference was 
considered indicated control schools were performing significantly 
higher. 

Conclusions • 

Within the parameters of ^this study, no statistically 
significant differences were found in the language arts 
achievement of children in IGE and non-IGE schools. Statistically 
significant differences in math tended to favor control school's, 
however. 

This study did not indicate what differences might be 
produced' by the IGE process itself. Perhaps the findings 
reflect on the quality of the particular curriculum adopted in 
math or reading; or perhaps they reflect more emphasis on the 
part of teachers in the areas of language arts and concept 
formation. Criterion-referenced testing may be more appropriate 
for the IGE setting than the norm based instruments, such as 
the Stanford. 

Within an innovative process which requires both reorganization 
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of the classroom as well as a change in curriculum, one might 
expect that a great deal of student energy is used in adapting 
to the new expectations. The findings here indicate that the 
achievement of these children is still at an approximately 
equal level with the achievement of children in control schools. 
Findings may also reflect a need for special attention to more 
"structured" skills, such as computation and vocabulary build- 
ing, when a school changes to a flexible organization and approach 
such as IGE. 
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Table II 

Language Arts 
Summary Statistics 



Test 


X 




STD 




S.E.- 






IGE 


Control 


IGE 


Control 


IGE 


Control 


Vocabulary. - 


26.62 


27.17 


6.39 


5.35 


0.49 


0.47 


Heading 
(Part A) 


36.30 


35.57 


9.52 


8.72 


0.73 


0.77 


Reading 
(Part B) 


34.35 


33.34 


12.41 


10.21 


0.96 


0.90 


Total Reading 
Scores 

(Vocabulary & 
Reading - Part 
A and B) 


97.28 


96.37 


26.37 


22.31 


2.04^ 

> 


1.97 



^ - 
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Table III 
LANGUAGE ARTS - SCHOOL DATA BY CODE 



EXPERIMENTAL GROUP 



Vocabulary Reading/Part A Reading/Part B Voccbulai 



Code 


Mean 


STD 


Mean 


STD 


Mean 


STD 


Code 


Mean 


50 


26.55 


7.10 


37.66 


7.61 • 


37.55 


6.65 


51 


26.70 


52 


31.30 


3.46 


43.20 


1.31 


45.20 


5.47 


53 


30.40 


5^1 


30.27 


4.54 


40.45 


5.12 


40.09 


7.79 






56 


32.07 


2:95 


40.53 


6.05 


41.76 


8.19 


57 


21.07 


58 


29.10 


5.89 


38.00 


7.94 


37.40 


10.01 


59 


28.20 


60 


23.66 


6.48 


33.88 


9.46 


30.66 


lii.30 


61 


26.80 


62 


29.70 


5.22 


40.60 


4.32 


41.50 


5.38 


63 


30.40 


64 


22. h5 


5.29 


29.66 


9.29 


24.62 


10.96 






66 


24.77 


5.56 


32.44 


9.78 ■ 


24.66 


9.83 


67 


30.60 


68 


22.36 


6.71 


30.09 


14.24 


27.36 


16.09 


69 


20.36 


70 


29.66 


5.12 


41.58 


3.44 


41.83 


6.80 


, 71 


29.78 


72 


24.80 


7.96 


33.90 


11.86 


35.10 


15.35 


73 


26.20 


7H 


30.00 


3.50 


42.77 


2.77 


44.66 


2.50 


75 


30.30 


76 


25.20 


5.32 


31.50 


13.58 


23.20 


11.39 


77 


26.70* 


78 


20-.90 


5.54 


35.60 


9.08 


31.70 


10.98 
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Table III 
















AGE ARTS - SCHOOL DATA 


BY CODE 










~ 








• 


CONTROL GROUP 








eading/Part B 




Vocabulary 




Reading/Part A 


Readins/Part B 


ean 


STD 


•Code 


Mean 


STD 


Mean 


STD 


Mean 


STD 


7.55 


6.- 6 5 


• 51 


26.70 


H.62 


36.20 


7.59 


32.09 


11.09 


5.20 


5.n 


53 , 


. 30.no 


3.80 


38.i»0 


' 5.29 


31.10 


10.65 


0.09 


7.79 
















1.76 


8.19 


57 


21.07 


5.86 ■ 


3^.76 


6,26 


32.00 


7.93 


r.^0 


10.01 


59 


28.20 


3.i*8 


3^.70 , 


7.55 


29.80 


11.82 


).66 


11.30 


61 


26.80 


3.70 


39.20 


3.99 


37.90 


5.11 


..50 


5.38 


63 


30. Ho 


2.87 


ill. 00 


h.5h 


29.70 


5.57 


f.62 


10.96 
















1.66 


9.83 


67 


30.60 


3.62 


37.50- 


3.92 


^1.80 


1.16 


• Jo 


lb . 09 


69 


20.36 


i|.36 


21.00 


11.28 


21.00 


10.61 


..83 


6.80 


71 


29.78 


3.61 


38.57 


8.26 


39.28 


8.50 


1.10 


1^.35 


73 


26.20 


5.71 


36.10 


8. on 


31.30 


10.13 


.66 


2.50 


75 


30.30 


3.91 


37.9„0 


8.65 


38.70 


8.91 


.20 


11.39 


77 


26.70 




32.00 


9.^7 


27.90 


8.81 


.70 


10.98 
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Table IV 



Test 



Mathematics 
Summary Statistics 



IGE Control IGE Control IGE 



Mathematics Concepts 
Hath Computation 



Total Math Score 
(Concepts & Compu- 
tation) 



n»19l n-132 

25.08 27.40. 6.32 5.08 0.45 



n-191 n»132 
24.40 26.95 



6.70 



n-191 n=132 
49.62 54.22 12.09 10.50 0.87 



Control 



0.44 

6.57 0.48 0.57 



0.91 
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GOAL I 

Objective 1.2 In comparison with children in control groups 
students in IGE classes will demonstrate significantly 
'"Ofe positive attitudes toward school. Comparisons 

■ using a t-test at a 0.05 level of significance will be 

made between test scores of children in control- 
settings and of test scores of children in IGE settings. 

Evaluation procedures ; , 

The same evaluation procedures which were implemented' with 
respect to cognitive testing were followed with regard to the 
affective testing. Due to the constraints bf the energy crisis 
it was necessary to change testing procedures for objective 1.2. 
It was not appropriate for a test administrator other than 
designated RETE personnel to administer the Attitude Toward 
Classroom Atmosphere (ATCA) inventory, the originally selected 
instrument. Due to these constraints and with the agreement of 
the New Careers in Education Office, the Piers- Harris Children's 
Self-Concept Scale (The Way I Feel About Myself) was substituted. 
This self-concept scale is self-report in format and is designed 
.for Children over a wide range of ages. The technical information 
for the Piers-Harris Children's Self- Concept Scale is found in 
Appendix B. The scale contains 80 items, with the highest 
attainable score being 80. 

Not all schools which had originally agreed to participate 
in this aspect of the testing in fact implemented the affective 
testing. These data are retained in the RETE log book. 
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Evaluation findings 

Summary statistics and school data listed by code are 
presented on the following pages. Mean total scores on the 
Plers-Harrls Self-Concept Scale range from 1|9. 11 to 69.20, a 
spread of almost 20 points, and well below the celling of the 
test (highest possible score Is 80). A check of the differences 
between matched pairs Indicates very little overall differences 
between the IGE schools and their control schools. Overall,- in 
ten of the pairs, differences favor IGE schools; In eleven of 
the pairs diffe rences favor the control school^ and In one _ 
pair the mean scores were the same. 

Statistical comparisons (t-test at a 0.05 level of signifi- 
cance) were made between mean total scores for IGE and for 
control schools. The findings are presented In table IX 
(Norms and additional data on the Plers-Harrls Scale are located 
In the appendix. ) 

As^ Indicated In table IX no statistically significant 
differences were found. Thus, it appears that children in IGE 

and In non-IGE schools do not differ significantly -in-self- 

concepts, as measured by the Piers-Harris. 
Conclusions 

Data indicate no significant differences between IGE and 
control schools in students' self-concepts. Perhaps changes 
that are occuring within the experimental program have nqt had 
time to affect the child's self-concept. At any rate, the child- 
ren in the IGE schools have experienced a new approach in school 
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organization and curriculum and maintained self-concepts that 
are similar to those in schools that have not made this change. 
Further stu^y is recommended as a means of indicating what 
affective changes may be produced by the IGE process. . 
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Even # - IGE 
Odd # - Control 



Plers-Harrls Self-Concept 
Scale 

Reading Group 



.School Code 



n 



STD 



S.E. 



50 
51 
52 
53 
51 
56 
57 
58 

59 
60 
-61- 
62 
63 
65 
66 
67 
68 
69 
70 
71 
72 
73.' 
7^1 
75 
76 
77 
78 



9 
10 
10 
10 
11 

13 
IH 
10 
10 
9 
11 
10 
10 
2H 
9 

10 
11 
11 
12 
li| 
10 
10 
9 

10 
10 
10 
10 



58. 
59.00 
61.50 
58.80 
61.36 
60.53 
063.35 
60.90 
59.i»0 
i»9.11 
5^i*.63 
56.70 
61.60 
5^1.^*5 
60.88 
57.60* 
51.63 
50.90 
62.00 
65.61 
57.30 
60.80 
65.11 
61.10 
51.20 
51.20 
56.70 



9.61 
9.32 
10.81 
15.17 
5.93 
10.76 
7.88 
9.81 
5.91 
5.71 
11.13 
16.16 

5.75 
11.55 
10.99 
10.21 
11.18 
12.86 
6.53 
9.67 
9.91 
11.66 
9.08 
12.78 
9.27 
19.61 
10.07 



3.21 
2.91 
3. 11 
1.79 
1.79 
2.98 
2.10 

3.11 
1.86 
1.90 
3.35 
5.11 
1.82 
2V35 
3.66 
3.23 
1.36 
3.87 
1.88 
2.58 
3.11 
3.69 
3.02 
1.01 

2.93 
6.20 
3.18 
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Even # - IGE 
Odd # - Control 



Table VIII 

Plers-Harrls Self-Concept Scale 
Mathematics Group 



School Code n X STD S.E. 



2.118 
3.10 

11.51 3.6i\ 



ft? ^2 ^^-90 7.86 

81 10 60.70 9.82 

82 10 58.90 

ftfi ' 11-02 3.67 

fl7 ^5 63.13 12.28 3.17 

ll 1^ 62. U3 8.89 2 22 

2S 20 60.15 11. H7 2 56 

10 59.80 10.51 3 32 

II 9 55.88 12.24 io8 

93 1^ ^^-^3 2.98 

oi? 15 56.66 13.53 "^.iiq 

«o 10 69.20 8.52 2 

9 l6 ^?-ft°? 'i'h 3: i 

100 13 2': 1.1 ^-^i 

12 61.08 10,11 I'll 

lOj 13 59.92 12. 7^ 3:53 

105 11 62.81 • 9.06 2 7^ 

16 63.93 10>82 I'M 

^SZ 16 ^9.81 13.83 ■ ■ 3 is 

111 .^^-30 11.57 3 66 

110 17 62.58 10.08 2.114 
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GOAL II 

Goal: As a result of state network implementation by the 
New Careers in Education Office, first and second 
cycle elementary schools meeting minimum IGE imple- 
mentation criteria will show characteristics which 
are likely to facilitate long-term commitment to the 
IGE process. 

Expenditures will show no significant increase 
for start up and maintenance costs. 

Pupil absenteeism will show no significant increase 
from previous years. 

Teacher attendance and turnover will show no 
significant change from previous years. _ 



Evaluation Procedures : 

RETE developed a survey form to elicit data pertinent to objective 
2.^a through 2.3. The following information was sought: 

Objective 2.1 

Amount and use of those funds available to the building principal 
of an IGE/MUS-E school, (i.e., whether the school, functioning 
within the IGE/MUS-E design is actually mbre costly to operate, or 
whether only a redistribution of monies is required. Areas under 
question will include hiring of para-professionals, unit' leader 
compensation, released time for teachers, and instructional materials.) 

Objective' 2.2 

Pupil absenteeism in first and second cycle IGE schools 
Objective 2.3 * 
Teacher attendance/absenteeism. Incidence of teacher turi^ver. 

The RETE developed data collection form (See Appendix A) w^ mailed 
to all IGE building principals listed in the New Careers Pertinent 
Data print-out in May, 197^ to allow for inclusion of data from the 
current academic year. 

Evaluation Results ; 

Responses from 26 of the building principals were received. Two of 
the principals indicated they were not implementing the process this 
year. The data are tabulated on page 26. 



I 



2.1 



2.2 



2.3 



Sff^ Lf^^ of principals who responded, five came from schools 
lilt one elementary school, eight have mote than three 

elementary schools, one has two schools, and one has three (Other 
sZ^l^'^r/r! "° descriptive Informat Ion! Sine o?* the 

wSe?eas fouJ h^^ represented had- only one school In the IGE process. 
Whereas four had two schools implementing IGE. The laree malorl^v 
of the schools (ten) began implementing in 1972-1973. ^ majority 

range of responses on the question dealing with staff positions with 
nine respondents rating- the question four or five on the con?lnuSi. 

With respect to start-up costs for the IGE process, a trend Indlcatlna 
an Increase in costs for paid para-prof esslSrials, inlt leader ^ 
compensation and release time for teacher in-service training 
was noted with the other expenditures remaining at the flxSd level 
A slight .upward trend in costs may also be notid for materials ?hat ^ 
are consumed and for equipment. (See chart on page 2?:) 

A slight downward trend with respect to' teacher turnover, teacher 
absenteeism, and pupil absenteeism may be noted. Generally, however 
these rates remainM .relatively fixed/constant. nowever 

Once the IGE start-up costs had been expended it seems that the 
Tifil^TT ^ J^*^ not fluctuate but remained the same. Aglln 
SJf^^r^^!^ teacher absenteeism and pupil absenteeism was 
t majority of the responses falling into the "remain 

JS^n'SbseSefJsJ;. ^"^"-^^ 
Evaluation Conclusions : 

the framework of this study, as a result of state network 
Implementation of the IGE process, no unusual increases in elthL ' 

i7^^T°^.'"4"*f^^"°® ^oted. These characteristics 

are likely to facllltat.e a long-term commitment to the IGE process. 

ovli\?m^^!I?^^^f!II ^f53°her attendance and turnover remained stable 
over time with the implementation of the IGE process and, "if anything 
I^sen?el?sm) ^^"^ (teacher turnove? and teacher/pupJl 
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Table 10 - Descriptive D&ta for Implementation/Maintenance 
Costs Questionnaire - IGE/MUS-E 



Number of elementary schools in district: 

_0 1 2 3 more than 3 

5 1.1 8 

Number of elementary schools in district implementing IGE/MUS-E 
as of school year 1973-1^7^: 

_Q 1 2 3 more than 3 



School year in which school building first implemented IGE/MUS-E: 

1971- 72 - 3 

1972- 73 - 10 

1973- 7H 1 

Degree of autonomy principal and IIC have in the following budget 

complete 
12 3 4 5 

Instructional 

materials 1 2 4 8 

Equipment 1 2 5 7 

Staff positions 4 2 6 3 
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GOAL II 

Objective LEA»s will be able to assess the effectiveness 

of the IGE process at the local level. 

Evaluation Process 

Local school districts need to assess for themselves the 
effectiveness of the process In their schools. For this reason, 
RETE has developed an evaluation procedures packet which can be 
used by any LEA who- is..partlclpatlng In the New Careers-IGE project 
and has not been designated as participating In the RETE-NCE 
evaluation design. 

The evaluation procedures packet contains names, sources, 
and background information on Instruments RETE has employed and 
information on additional Instruments which may be applicable. 
References on community attitudes surveys are also Included. • 

This packet is to be made available through the New Careers 
in Education Office. All or part of this packet may be employed 
by the LEA's at their discretion. Appropriate data analysis 
techniques are to be determined by the LEA with guidelines 
supplied in the packet. 
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' _ Methods for Evaluating 

An Individually Guided Education (IGE/MUS-E) Environment 

School districts who elect to implement the jge ADoroach 
to education often need assistance in evaluating progress in the 
implementation and in utilizing data from such tvaluftions to mike 
Sm^ °^ improving the implementation process 

ESicatfon flE5l? "^f? Evaluation 5IIm for 

New Jersev af «Ji-o^n.^f"°^*^?"f ^ Improvement Center of Northwest 
wew Jersey as an attempt to assist schools in fhis process, included 
are overall suggestions for selecting and developing a design and 
sample instruments or instrument sources for objectives that ha?e 
been measured by RETE in previous work. "^jectives cnat have 

PLANNING AN EVALUATION TO SUIT THE SCHOOLS NEEDS 

This package cannot substitute for a great deal of planning and 
choice-making on the part of the school personnel, howeverf ?t 
is not possible to attend to all aspects of the Imple- 

nno!??i°?/''°^^f^ ^""^ is not possible to provide 

3he?e tf foLf ^neSSi:^^^^'"^^ "^^^ personLl mult decide 

answered ^ ^J^J ^""^ "^^^ questions need to be 

fafrr^r following list of tasks has been included to facili- 

tate this planning process. School personnel should ask themselves. 

t;ach^?s,^etc!*) ^^"-^''P^^* answers? (parents, funding agencies. 

In hn?J J"^s*i°"s can they expect to have answers? (relevant 

m?ghf Sanftf cSf:k)'°" '^^'^^ "--^^^ °^-ses you • 

f;pi???Lf ^ schools philosophy, community climate, 

ii^^r^/*?; "i^^ influence the results that you- wish (and 
can realistically hope to obtain) ? 

t'nu J"*®^a°*i°ns (teacher/teacher, teacher/student, etc.) would 

the prSjec??^"" ^""^ important for reaching the 'goals o? 

tl^.h^S k''^""?^^ ^^^^ *° produce (in student behaviors, 

teachers behaviors, school organization, etc)? uciiavj.ux£,, 

6. What evaluation conditions are realistic in your settine 
(money, time, and other resources?) 

InatlJnnpnfi^ evaluation? (for administering 

aniJyzJnf ?esS??s''efc?f ^^^"^'"^ confidentiality of scores. 
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8. Who will be responsible for formative feedback and for 
reporting and interpreting results (and to what audiences)? 



After an outline of objectives to be met and a plan for 
chain of responsibility in the evaluation have been determined, 
appropriate measures can be selected.* Consideration should be 
made for the amount and type of skill required for (a) 
administration of the instruments (teacher, trained observer, 
psychologist, etc.) (b) scoring and tabulating data (c) 
analyzing data (by computers, by hand, what statistical 
treatments), (d) interpreting and reporting results. In 
addition, measures that yield valid and reliable scores 
should be sought. (In many cases a sophisticated instrument 
may not be as appropriate as a checklist or self-report 
questionnaire that more closely matches goals.) 
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PROCEDURES USED BY RETE 

RETE has utilized a variety of measures in different types 
of settings. The particular instruments compiled below 
represent only a few of the possibilities a school may wish 
to try. The intent of the following is not that a school 
should Implement the total package or even parts of each 
aspect, but that the school be able to choose the aspects 
most suited to the plan for evaluation they have developed. 
In the appendix a copy of the Policies and Procedures 
Manual for RETE and an evaluation design for Individually 
auided Education (IGE/MUS-E) are provided. The purpose of 
this inclusion is to trigger thought and to provide a model 
for pr^esentation, if desired. 

RETE implementation of this design has included the initial 
presentation of the rationale to the project staff, identifi- 
cation of the student sample, test scheduling, conditions for 
test administration, monitoring of data scoring, data 
analysis, presentation of feedback to the project staff, "and 
summation of the data in a written report. 

Instruments 

The instruments developed/identified by the Research Evaluation 
Team for Education for this evaluation have been classified 
according to three basic categories: 

1. student instruments 

a. cognitive outcomes 

b. affective outcomes 

2. teacher self-report instruments 

a. planning behaviors and priorities 

b. differential open/traditional behaviors 

3. community survey instruments 

S5 



mav i. lZ^ f description of each instrument that 

may be used in evaluation of the IGE settings, the source of 

^SnP o?'''"'"^"''' ^^^^^ °^ ^^"^ required fo? adraJniSionf 
' tVnL or response elicited, and appropriate applica- 

SseS rSt?'*'?^'? i^e^^f the instruments which were 
^l.Lt^ 5 ^"fl^sion should not be considered as a 

recommendation, since each local school must decide whether 
those particular questions need assessment. 

Student Cognitive Outcomes 

r^gnft? -measures Those schools that elect to measure 
cognitive growth have several choices. Some schools will 
wish to continue with the same standardized tests they have 
used previously. This selection will provide longitudinal 
data and allow for comparisons of grdwth in children who have 

K h^^ M.???r^^if^%r^i"'" ^^^^1^ °^ achievement. 

RETE has utilized the Stanford Achievement Test, 1973 edition 

v,^°^°°^^*^^* "^^^ *° a measure: The 

5taniord has an advantage of more current norms. 

!^Lm^^"^°u'^ Achievement Test * provides six battery levels which 

performance from the middle of grade 1 through 
f^?iod?n^\°^®''/^! ?• '^^^ complete battery contains the 1 
Ihllh i^v ,1 {^^'"^"istration time indicated in parentheses) 
which may be isolated to meet specific needs: 
Vocabulary (20-25 minutes) 
Reading Comprehension (35-^5 minutes) 

Word Study Skills through Intermediate II (20-25 minutes) 
Listening Comprehension through Intermediate II (25-35 ninutes) 
Mathematics Concepts (2O-35 minutes) ninute^; 
Mathematics Computation (30-35 minutes) 

Language (beginning with Primary IIIj 35 minutes) 

f°?i^L^^K'^^r """^ Primary II j "20-30 minutes) 

Science (beginning with Primary II; 20-30 minutes) 

While each level is primarily designed for specific grade/age 
ranges, all levels have been normed in a manner which makes 
it possible to use any one level in a multi-age, continuous 
progress setting as well as for pre- and post-testing. The 
content has been designed to meet the latest curriculum trends 
in skills and concepts. The tests are intended to be 
administered by teachers. RETE recommends that this be the 
procedure within this design as well, since the children are 
more accustomed to such experiencfes with their teachers than' 
with outside evaluators. 

The use of a standardized test allows comparisons of student ' 
achievement with a normative group. Some schools will find 
the normative comparison inappropriate for their purposes, 
however. 



2- Criterion-Referenced Tests Schools that wish to utilize 

h!??™%^ f""^ ^"^^^^^ ^° ^^^^^ objectives and who 

believe the only appropriate comparisons are changes that 
occur within the Individual children from one tlmi Interval 
purpose "lay select criterion-referenced tests for this' 

sources for item pools for the construction of 
cptterlon referenced tests Is included in the appendix. 

Criterion reference tests are most effectively used by the 

oi the°^M?H^f ^tu^ '"l^"' °^ obtaining continuous feedback 
p Ho^^r^f^J^ P^e-P°st comparisons can be made on 

a descriptive (or percentage) basis. 

Student Affective Outcomes 

thif't^e JLh?f nr^ii^ important in measuring affective outcomes 
l.tl °i students be protected and that (a) they 

Jll °r refusing to answer, (b) the answers they 

give be kept in strictest professional confidence, and (c) 
tJ;r?^sr:aJ?antsf^'' °" individual scores be made only^liere 

Schools should consider identifying or hiring outside consultant«= 
to administer instruments and handle data. consultant. 

n^.^^^y^^ Toward Classroom Atmosp here (ATCA) This 30 item 
attitude inventory was developed by RETE, based on initial 
Crlv/°r^.f Institute for Educational Research, Downers. 
filT '.r. lii^°il\ '^^^ ^'^^^ ^^^'^ the students below grade 
S??iculMp^ their responses will not be confounded by refdlng 
difficulties. Students are asked to indicate agreement or 
disagreement with each statement by marking YES or NO with * 
an emphasis on the fact that there are no right or wrong 
fee??n^; «h^ni- f^^^^S^ f""^ designed to reflect the student's 
fs ii?? %f interpersonal relationships in school 

as well as his/her perceptions of the role of a student in 
r^SL^"'' '^^^ instrument is available with two answer 

olde? 'children. ' ^""^ ^^^""^ graders; another for - 

^i^^^iif!? no special skill is required for administration of 
the ATCA, the level of trust between the administrator and the 
aSpa very important for obtaining valid scores. The 

ATOA yields total scores which can be used for pre-post 
comparisons for groups only. The instrument has not been 
mini?If hoSe^ei!""' ^^""'^ utilLatioiTTs a diagnost^ic 
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b. Plers-Harrls Children's Self Concept Scale (The Way I Feel 
About Myself )* This bO item attitude inventory was developed 
by Ellen Piers and Dale Harris (published by Counselor Record- 
ings and Tests, Box 6lQ^\ Acklen Station, Nashville, Tenn.) 
"The Way I Peel About Myself " is a quickly completed (15-20 
minutes) self report instrument designed for children over a 
wide age range. Administered in group form it requires 
approximately a third-grade reading knowledge. On an indivi- 
dual basis it might be used below that level. It can be 
administered and scored by responsible, educated non-psychol- 
ogists, but should be interpreted only with the aid of ' 
someone knowledgeable in measurement and statistics, psychology 
of adjustment, and self-^.theory . The Scale was designed prim- 
arily for research on the development of children's self 
attitudes and ^oi^elates of these attitudes. The instrument 

is not for diagnostic purposes with individuals, but can 
provide valuable Information for groups. 

c. Satisfaction of Values Inventory (SAVI) This self-report 
inventory is a RETE developed instrument designed to measure 
the degree to which the 9-1^-year-old child perceives his/her 
needs are being met in the eight values categories described 

by Dr. Harold Lasswell. (i.e. affection, enlightenment, skill, 
wealth, power, rectitude, respect, and well-being) The 
instrument assesses the contributions to value satisfaction 
made by four major categories of significant others: the home, 
the school, the peer group, and the community. The items are 
read aloud so that responses will not be confounded by read- 
ing difficulties. Students are asked to indicate whether 
they feel as the statement describes "often," "sometimes," or 
"almost never" in each of the aforementioned settings, i.e. 
making four discrete responses to each stimulus. There are 
32 statements in all, four in each value category. The Instru- 
ment, which is computer scored, yields a total score, eight 
subscores for the values categories and four subscores for each 
category of significant others. The SAVI yields a pattern of 
scores in a relatively short amount of administration time. 
Scoring is quite complicated for large numbers of students, 
however. 

^- Preatlvity Attitude Survey (CAS) This self-report inventory, 
appropx-xaLe ror graders, was developed by Charles E. Schaefer, 
Ph.D., and is available from Psychologists and Educators, Inc., 
Jacksonville, Illinois, 62650. This instrument is included 
in this design under the assumption that one of the goals of 
the open setting Is to encourage the development of positive 
attitudes toward creative behaviors and a positive evaluation 
of oneself as a creative thinker. The CAS consists of 32 
statements for each of which the child is to indicate agreement 
or disagreement. (Two of the items are "fillers" designed to 
reduce the visibility of the instrument.) The instrument 
measures the following dimensions associated with creative 
achievement: confidence in own ideas, appreciation of fantasy, 
theoretical and aesthetic orientation, openness to impulse 
expression, desire for novelty. Each item can be read aloud, 
eliminating possible confounding effects of reading difficulties. 
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The CAS, ATCA, and SAVI have been used in several groups, and 
comparisons can be made. The development is still in process, 
however.. The decision as to which instrument to use will 
depend on the specific objectives the school wishes to measure. 
Sociometrics 

3~. ciome teachers may wish to assess friendship patterns and 
cohesiveness within their groups. This information can be 
useful for teachers as they make suggestions for small group 
formation around a task and for identifying children with 
leadership positions or those who are isolated from other 
children. The sociometric consists of the teacher's asking 
each child to list three other pupils (i) with whom they would 
like to do a project and (2) that they wouldlike to play 
with at recess, (other situations could be substituted if an 
activity such as a party is actually planned.) Suggestions 
for analysis and use of the data are included in the appendix. 

Teacher Self-Report Instruments 

The following are possible ways in which teachers may check 
their own behavior against their goals and may assess team 
«n!J°Ji?r^"^* ^^^^^ measures are descriptive in nature only, 
and total scores are not appropriate, if group data are 
desired tallies of the number of responses and percentages 
are appropriate. It is important that teachers decide prtor 
to use of the instrument exactly what objectives they do 
wish to show. Thus, a discrepancy between where they would 
like to be and where they actually are can be obtained. 

a- Classroom Planning Survey (CPS) A RETE-developed self- 
report instrument, the CPS asks the teacher to indicate the 

In ?^^''!r.f^!^''r?^.?^^^^^'!?^"S ^""^ implementation behaviors 
in the areas of individualization, grouping criteria, 

""^u^^* ^""^ teaching/learning resources. The data 
elicited by the items are descriptive in nature and are most 
appropriate as criterion-referenced information. The CPS 
also, offers the alternative of establishing a given score 
as indicating achievement of target levels. Discussion within 
t,he teams of responses given by individuals can be fruitful. 

Feedback: Process Moni toring Cards This approach to 
monitoring and providing continuous feedback has been 

?ni'?p°Q!'^ ??n?''?^*i''?oi'^^^"^"S Systems, Inc., Park Centre, 
Suite 9A, 1701 East I2th Street, Cleveland, Ohio HHllH 
The cards are used by a person who fills the role of grouo- 
process observer, and provides for monitoring the statements 
of group members that fall into eleven different categories 
of behaviors that facilitate or block group functioning. 

Community Survey Instruments 

ti^J^^^ following documents may be retrieved by use of the 
ERIC document retrieval service (Note ED numbers): 

EJ063169 AA513297 

A SURVEY CAN INCREASE SCHOOL-COMMUNITY INTERACTION 
Phillips, John D. Pennsylvania Education: 3: 6: O-io Jul-Aug 72 
?dn?M^ff/ f Inexpensive and relatively uncomplicated to 
administer, designed to measure community attitudes toward 
schools (Author, SP, summary) towara 
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ED06366i» 2H EA00i»3^7 

A Study to Determine the Feasibility of Adapting the Gallup/ 

CP. Kettering Model for Surveying Public Opinion of Public 

Schools for Surveys in Local School Districts. Pinal Report. 

Gish, Elmer H. Virginia Univ. Charlottesville 

A feasibility study was made of the Gallup/Kettering "plan for 

support in locally conducted surveys of public opinion about 

the public schools by implementing the plan in Richmond, Virginia. 

The methods used in the local survey, as well as the findings 

and conclusions of the feasibility study, are reported in 

this document. A related document is ED Oi\6 097. (author summary) 

EDO2OO5I RC002i»79 

An Instrument Designed to Secure Information Relative to 

Community /g;f jtudes 

Davis, J. Cl€«>k; Jesser, David L. 

Nevada Western States Small Schools Project. Carson City. 
Pub date 290CT62 Note-19p 
EDRS Price MP-$0.65 HC-$3.29 

A SOchoice attitudinal scale was constructed to determine 
community attitudes and perceptions which might affect the 
school program. The scale was constructed around 1 general 
and H specific categories— (1) administration, (2) finance 
(3) general attitudes, (H) personnel, and (5) program. The 
survey instrument is included, as well as data on sample 
selection, category frequency distribution and item analysis, 
and specific recommendations for administration and scoring. 



EDO26716 EA991926 

The Schools and the Community: A communications study. 
Suburban area study group. Silver Springs, MD 

Spons Agency-Eugene and Agnes E. Meyer Foundation, Washington, D.C. 
Pub data- Jul 66 Not-il56p. ^ 
EDRS Price MF$0.65 HC-$l6.il5 

This comprehensive report of a 2-year study (196^-1966) of 
communications between the schools and the community includes 
descriptions of seven related study projects. Procedures and 
methodology for an effective school-community public gelations 
program are described in a professional handbook produced as a 
result of the overall study. Fourteen steps for fact-finding 
and analysis of need, administrative, planning, and program 
operation are explained. JUhe seven study projects are (1) 
a survey of attitudes and information about public schools in 
Montgomery County, Maryland, ^^a survey of school-community 
information services, (3) a sfelKol news survey and content 
analysis, (H) identification of county organizations and their 
relationships to schools, (5) a survey of school-community ' 
information programs in Maryland, (6) a survey of selected 
school public relations programs in 29 communities across the 
.United States, and (7) the preparation of a school public 
relations bibliography of over 3OO items availabel In the 
Washington, D.C. area. Appended questionnaires are 
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accompanied by a description of procedures followed for 
sampling, distribution, followup, and coding of responses. (JK) 

b. Belden Associates (Southland Center, Dallas, Texas, 75201) 
conducted a 1972-73 national evaluation study of the IGE 
program for Institude for Development of Educational Activities, 
Inc. (IDEA). Aspects of the report focus on the following: 

1. evaluation of the level of Installation of the organization 
and the processes of the IGE program 

2. assessment of the behavior of the groups of people involved 
directly in the IGE system, 

3. measurement of the attitudes of the people toward IGE and 
its effectiveness 

Pour questionnaires have been designed by Belden Associates 
for gathering data from school administrators, teachers, students 
and parents of the students in IGE schools. The questionnaires 
elicit information about: 

1. the expectations of the various groups about IGE 

2. opinions about how the expectations have or have 
not been met 

3. the concepts that each group has of its roles and 
the roles of others in implementing IGE 

'i. perceptions of the changes being made in the IGE 
system 

5. opinions about the effectiveness of IGE 

c. Educational Values Assessment The Educational Values 
Assessment Questionnaire (EVA) was developed by Harry 
Gottesfelf' (Behavioral Publications, Inc., 2852 Broadway, 
N.Y., N.Y. 10025) to determine educational values of 
individuals and groups, it focuses on beliefs people 
have about what is important educationally for the child 
of elementary or junior high school age. 
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The following are sources of item banks ^ including access to prepar^-d 
lists of educational objectives: 

Comprehensive Achievement Monitoring 

Robert Reilly, Chief 

Bureau of School and Cultural Research 

University of the State of New York 

State Education Department 

Albany, N.Y. 12224 

CTB/McGraw-Hill 

Department of Programs and Services 
Del Monte Research Park 
Monterey, California 93940 

Instructional Objectives Exchange (lOX) 
Box 24095 . 

Los Angeles, California 

Minnemast Curriculum Project 
Wells Hively 
Department of Psychology 
University of Minnesota 
Minneapolis, Minnesota 

Southwest Regional Laboratory for Educational Research and Development 
4665 Lampson Avenue 
Los Alamitos, California 90720 

Educational Commission of the States 
National ^^Assessment Publications 
300 Lincoln ToWer 
1860 Lincolri^-St. 
Denver, Colorado y0230 

Educational Progress. 
Educational Development Corporation 
4900 South Lewis Avenue 
P.O. BOX 45663 
Tulsa, Oklahoma 74145 

Training Projrct 

Center for Study of Evaluation (CSE) 
145 Moore Hall 

University of California at Los Angeles 
Los Angeles, California 90024 

Richard L. Zweig Associates, inc. 
20800 Beach Boulevard 
Huntington Beach, California 92648 

Educational Testing Service 
Princeton, N.J. 
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Research for Better Schools 
1700 Market St. 
Philadelphia, PA 19103 

Downers Grove Behavforal Objectives and Test items Bank 
1400 West Maple Ave^ 
Downers Grove, 111. 60515 
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S A V I I 

Directions: These are some statements that describe how a person your age 
might feel. Decide how often you feel this way. Place an X under "often," 
"sometimes," or "almost never" to show how frequently you feel this way 
when you are at home 
when you are at school 
when you are with friends , and 
when you are in your community . 

In other words, when you read a sta'ement, you will make four Xs (one X for 
each of the four different places you might be.) 

1. I feel good here. * 

2. Viy privacy is respected by people here. 

3. People here think about other people's rights before they act. 

4. I have trouble saying how I feel. 

5. When I am away, I miss these people. 

6. People here want me to use things wisely. 

7. I help make the rules we follow here. 

8. I know the answers to questions people ask me. 

9. I feel tense and nervous here. 

10. People make fun of others who do not read well. 

11. I can trust people to keep their word* 

12. I can do things as well as people here can. 

13. People are friendly to me. , 

14. People here have more things than I have. 

15. I am expected to go along with what other people decide. 

16. People here help me learn about things that have worked in the past. 

SAMPLE - NOT FOR DUPLICATION (For additional copies, administrator* manuel, 
test development information, and student answer sheets contact: EIC-NW 
Halko Drive, Cedar Knolls, New Jersey 07927). 

PLEASE TURN THE PAGE OVER 
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17. If I feel sick, someone here will help me. 

18. People respe ct me when I do something well. 

19. People break rules if they think they will not get caught. 

20. I can leiarn to do things here with my hands. 

21. I really like being with people here. 

22. I have enough money for what I need. 

23. People go along with what I need. 

24. Other people seem to know more than I do. 

25. I like the way I act. 

26. People listen to what I say. 

27. I am treated fairly here. 

28. I have a chance to learn new skills here. 

29. People here dislike me. 

30. People here help me find ways to make money. 

31. I make my own decisions. 

32. What I learn here will be important to me in the future. 
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SAMPLE - NOT FOR DUPLICATION CPnv* oaaa^. 
administrator directions tL/J^fL?^^^^°"^^ copies. 



. Attitude Toward Classroom Atmn.pu 
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>■ I like to tell my teachers about things that happen to me. 

2. My .encher(.) helps me when I do not understand something. 

3. I can't .isk questions in school. 

4- My teacher like it if I bring in things to share. 

5. I'm not very important in my classroom. 

6. I sit at my desk almost all day. 

7. I can choose many of the things I do during the school day. 
S. I think I'm pretty important in my classroom. 

I think my school work is not very good. 

10. My teacher(s) let me ask questions in school. 

11. We have very few interesthig things to look at in school 

12. I have to ask the teacher(s, every ti'me I get out of my desk. 

13. 1 think my teacher is happy. 

14. My teacher (8) lets me answer lots of questions. 
J-^ I think my teacher(s) does not like me. 

teacher (s) like to play games with us. 
17. Even when someone is stuck with a problem, I am not allowed to h.I,: 
I«. I pet worried when I make a mistake at school. 
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19. My teacher (s) likes me. 

20. We do not do very interesting things in our classroom. ^ h ' ^ 

21. Sometimes my teacher(8) lets me do Just nothing for a while. ' " • 

22. I wish I had more time to look at someflilng besidcB books and worksheets. 

23. Sometimes my class does work outdoors even If It Isn't recess lUne. /'i^ 

24. My teacher(s) does almost all of the talking in my class. ] • / 

25. We have lots of interesting things to do in our classroom. . 

26. My teacher(s) does not like me to bring in things to share. : 

27. My teacher(s) lets me help a friend if he or she is stuck with a problem. '. 

28. I almost always have to do Vi^at everybody else in my room is doing. . 

29. Sometimes my friends and I work on things and the teacher(8) doesn't have 
to help us. 

30. I think I do pretty good work at school. 
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Bonney-Fessenden 
Sociograph 

DESCRIPTION OF THE SOCIOGRAPH 

The Sociograph is a chart designed to simplify 
the recording and interpreting of sodometric data. 
All the recording spaces required in a complete 
sodometric appraisal have been-cbnveniently ar- 
ranged on the inside of a specially-printed manila 
folder. 

The choices given and choices received can 
be plotted quickly for members of groups up to 
forty in number. The Sociograph employs one 
triangular-shaped graph for this. In essence, this 
graph is one half of the familieur square tabulation 
chart. By dividing each square into two halves on 
the Sociograph and by plotting data in an easily 
established pattern, mutual choices occur in one 
square, and the particular group choice-patterns 
are readily revealed. A circle can be drawn aroiuid 
mutxial choices to make identification easy. This is 
a unique and timesaving feature of the Sociograph, 
The development of this chart is discusi^ on 
pages 4 and 5 of this Manual. 



THE GRAPH 

On the center portion of the folder is printed 
the triangular gr^h or chart to which reference 
WM just made*. Qioices given, by members are 
recorded on this diart and from it information re- 
garding chareicteristics of the group is obtained. 
U.desired* the order of dioices and rejections can 
also be recorded equally conveniently. 

To ike left of the graph are spaces for the names 
of the pupils. Each name space is followed by an 
Identification number which in edso jdaced at the 
base of the columns and on the diagonal portion 
d the graph. The number on the diagon^ is used 
to identify both the line and Its corresponding col< 
umn.^ These numbers are used by the class mem- 
bers in making their responses to the sodometric 
questioxu when the speded answer slip is utilized.' 



SUMMARY COLUMNS 

To the left of the name spaces are six columns 
in which the data recorded in the graph are sum- 
marised. Foiu^ of these columns have been given 
headings. They represent areas that have been 
foynd to be most important in group and individu- 
al analyses. The description of the mx columns 
follows: 

A. Choices Given. This column refers to the 
number of persons chosen by each member 
of the group for the spedfic occasion of the 
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Description of the Sociograph 
Development of the Sociograph 
Reliability and Validity 



sodometric question. Frequently the exam- 
iner limits the number of choices the group 
member may make. This column vrill then 
not be used. On other occasions the number 
of persons to whom each member is asked 
to respond is left open. In these instances 
the examiner may feel that the number of 
choices has some importance for his analy- 
sis and should be totaled. 

. Choices Aeceived. This column totals edl 
choices received. No speded space is pro- 
vided in which to record 1st, 2nd« 3rd, etc., 
choices even though the question asked often 
requests that the group member list his pref- 
erences in this order. While it is true that 
first level choices have been found to be 
more constant than any other, a member's 
TelativB rank in his group will prove to be 
very much the same whether preferentied 
recording is or is not used. The chief value 
of preferential choices td teachers or group 
leaders is that they serve as guides in put- 
ting members together in subgroups* 

. Mutual Choices, It is often valuable to the 
examiner to know the extent to which each 
person chose others who also chose him. 

I These mutued or redprocated choices are im- 
portant in examining the status of a group 
as a wholes in establii^ing subgroups, and 
in appraising individual attitudes and rela- 
tionships. 

. Relections Received. When the members of 
the class or group indicate those with whom 
they prefer not to be eusodated, the number 
of times each person is rejected can be 
totaled in this column. This number may be 
quite indicative when compared with the 
choices received; Rejections are -seldom 
made in rank order of 1st, 2nd« etc. 

Unnamed Columns. Two of these are in- 
cluded in the Sociograph tot summarising 
other data from the chart that might be im- 
portemt to the examiner. Such data might be 
relative to the number of boy-girl choices, 
interradal choices, or emy other cross-group 
choices that the examiner might wish to in- 
vestigate. Often the privilege of rejecting 
sodometrlcally is given. One column can be 
used to indicate the numbers of rejections 
made. These columns can also be used to 
total scores, to estabhsh rank order, to pro- 
vide weighted scores, and the like. 
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averaging lines are provided at 
in« oottom of each oi the summary columns. 

INTMPII6TATI0N OF DATA 

The right aide of the folder contains, as its 
major feature, space in which to record whatever 
interpretaUons are to be made. Headings provided 
!2^Ir?|!^''®J"'l'"'^®' Characteristics, Indi- 

durion?*^ ^^^"P*"^*' O^her Con- 

INSTIUCTIONS 

Instructions are found in two places in the 
folder. A brief illustrated set of instructions is found 
immediately to the right of the center line on the 



inner side of the folder. On the back cover will be 
found a summary of directions, uses, and interpre- 
tive guides. These directions are obviously not aa 
detailed as those found in this Manual. 

IDENTIFYING DATA 

Also included is the space in which the follow- 
ing identifying data are recorded; Qass or Grade* 
Date, Teacher, School, Purpose, and Question Used. 

Thus the Sociograph is a durable form of*con- 
venient size on which data can be readily record- 
ed. It retains all of the advantages of the sodogram 
and the matrix heretofore required for sociometric 
appraisal. With it, many useful facts about group 
interrelationships can easily be obtained. 



DEVaOPMENT OF THE SOCIOGRAPH 

Sociometric research has long employed two 
kmds of mstrumentsjthe square graph, ot matrix, 
and the sociogram. This latter device was devel- 
oped so that the lines of attraction or rejection be- 
P«was could be visualized more effec- 
tive y. Its grapbc or pictorial form has become 
weu^taown. It has, however, the disadvantages of 
bemg frequently difficult to construirt, of not being 
subject to mathematical analysis, and of making 
^iS*^*^!^"' between two or more administrations 
dimcult. Considerable confusion may develop in 
facing the lines when the group is large, when 
the responses are many, or when more than one 
question IS plotted on the same chart. 

Samples of these procedures are given in 
Jennings,^ Moreno,* Northway/ and other refer- 
ences given at the end of Part 2 of this Manual. 

k ?!,'^:».^? Sociograph is a square tabulation 
cliart folded into a triangular shape in such a 
way that the squares common to two people co- 
indde.* In the usual square tabulation chart, there 
are two squares for each pair of persons involved. 
In Figure I (in which 1st and 2nd choices have 
been recorded), for example, the squares in the 
upper right-hand comer and lower left-hand cor- 
ner are common to students A and D. 



*0bW»uily Jh* chait not bm fold«d. U « aouar* «AhuU(iAii 
Th.M tqu«r.. btcom. autiS tqu.!ii | a si^r^r^^^ 
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FIG. 1. Four-Unit Square 

l^e choices made and received can easily be 
noted and totaled. However, even in this small 
umt, the pairs of mutual or reciprocated choices 
do not stand out clearly enough for them to be 
easily identified. If the chart is "folded" as rep- 
resented in Figure 2, one can readily see that there 




Choostr* 
and 
Choitn C 



HG. 2. "Folded" Four-Unit Square 

are mutual choices between students A and 
B and between students B and D, because the 
data trom the common squares are now together. 
This process causes the Sociogtaph to be cut 
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diagonally on the open squares, the ones in which 
a person might choose himself. Inasmuch as these 
are not used in sociometric appraisal they are not 
included as squares in the Sociograph. 

hi order to make the relationship more mean- 
ingful, it is necessary to establish a definite plan 
for designating who chose whom. With the Socio- 
graph this is done by dividing each common 
square with a vertical dotted line. The left-hand 
halves then represent the lower left-hand portion 
oi the original squeure, and the right-hand halves 
repr^ent the upper right-hand portion of the orig- 
inal square tabulation chart. Thus, the basic unit 
of the Sociograph, represented in Figure 3, eneibles 
one to note the relationship as shown below. 



Square Chorf Unit f ^M Sodogrttph Unit 
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FIG. 3. Contrasting Square Chart Unit and- 
BaaaSodograph Unit 

Referring to the Square Chart Unit in Figure 3, 
Student A would be able to put his choices into 
ttie upper right-hand portion only. In the Basic 
Sociograph Unit, therefore, all of the choices he 
made would be noted in the right-hand half of 
his vertical column. His first choice was Student B; 
his second choice was Student D. 

Again refening to Figure 3, Student B's choices 
would bo recorded in both halves of the Square 
Unit. Student B has one square in the lower 
left-hand portion of the square chart, in Student 
As column, and two squares on the upper right- 
hand portion, those common with Students C and 
D. It can be noted that his first choice is Student D 
who is on the right-hand side of the square chart 
in Student B's line and is therefore represented by 
the right-hand side of the square common to Stu- 
dents B and D in the Sociograph unit. His second 
choice is Student A who is on the left-hand portion 
of the square chart and therefore represented in 
the left-hand side of the mutual square in the 
Sociograph unit. 
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FIG. 4. Sociograph Units Illustrative of Recordings 
of Choices by Students A, B, and C 

Rgure 4 represents the recordings of choices 
made by each of three students. Student As re- 
cordings are both in the vertical column. Student 
Cs recordings are bo H in the horizontal line. 
Student B has one recording in a column and one 
in a line. 

In this Manual the word line will mean the 
horizontal group of squares belonging to any one 



person such as: 



!2 



2i 



A column 



will mean the vertical group of squares belonging 
to any one person such as: 



It will be noted, therefore, that each student, 
except the first and last, will have both a line 
and a column. C, in this instance, has a Unm: 




and a column: 



In the Sociograph this principle is extended to 
include 40 people. Choices given are recorded in 
the left-hand half of the square in the line which 
indicates it would be in the left-hand portion of a 
square tabulation, and in the right-hand half of the 
square in the column, which indicates it would be 
in the right-hand portion of a sG[uare tabulation. 

ANSWCR SUPS 

Each Sociograph is accompanied by five sheets 
of eight answer slips which are to be separated 
along the perforated lines and distributed to the 
members of the class for use. These emswer slips 
are Mmply deugned and perfectly matched with 
the squares on the Sociograph. A partial reproduc- 
tion of an answer sUp is found in Figure 5. 



1 I 2 I 3 I 4 I\yi5ll6ll7liall9l({li5 26127 



Nome. 



Number.... 



Class... 



33l34l35l36l37138l39l40 



Date. 
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REtlABILITY AND VALIDITY 

-THE ifUABIUTY Ok CONSTANCY OF 
SOCIOMETRiC SCORES 

When confronted with the qttestion of the re- 
M^ihiy o| sodometric scores, one is faced with a 
different situation than is umsdly found in psycho- 
logical testing. Instead of measuring some quality 
or capaaty which is presumed to remain approxi- 
mately constant in the same individuals over a 
period of time (such as a few months, a year, or 
even much longer), we are, in sociometric testing, 
measmmg the interpersonal responses of the mem- 
bers ol a group toward each other. There are no 
grounds for assuming that these responses should 
remam entirely constant over any given time in- 
terval. Jn fact, it is to be assumed that some 
,1^^®? mterpersonal feelings are taking place 
ail the time. Even over such a relatively short time 
mtenral as one month, one would expect some 
mejMurable changes to take place. This would be 
particularly true if some kind of socializing activi- 
ties were introduced into the group being tested. 

Studies which have been made on the con- 
stancy of sociometric measurements vary to some 
extent depending upon whether they deal with the 
constancy of individual-to-individual responses or 
t^e constancy of total group status based on the 
choices received. 

The individual-to-individual responses may 
change considerably over a time interval as short 
as one month. In fact, in some populations only 
about thirty per cent of the total choices expended 
are given to the choice recipients by the same 
choosers on two successive testings. As would be 
expected, first-level preferences are found to be 
much more constant than lower-level preferences, 
to studies reported by Criswell,^ Deutschberger/ 
and Northway,» first-level choices are shown to 
be at least twee as constant as are lower-level 
choices. 

When turning to the constancy of relative 
group status based on total choices received, one 
finds much greater stability than in the case of 
individual-to-individual choosing. In surveying 20 
shidies which have given data on the constancy 
of sociometric positions over varying periods of 
Ume, it was found that in those in which the time 
interval was one week or less the median rank- 
order coefficient was .90. Representative studies in 
this area include those reported by McKinney,**' 
Zeleny,^ ^ and Monton ef aJ. " 

From the above survey a good many shidies 
were found in which the time interval between 
test and retest was from two to nine weeks. The 

Tjeam CHtwvU. A Sociom^ttlc Study ot Rmem cimMam in ik^ 

so<5oW:y^i»M^ air^*^*^'^ ^^^^^^ 

KVlMO)? m"pp'. ^•^'•^ Unly.«ft? of To.oSto 

F« ?fS^^"P-?''. E<Jucatton*l Application of a Two- 

SS Sociom.tric M.Mur.t/* Socfom./ry, 18:7-48. r.brutfy' 



median coefficient calculated from these shidies 
proved to be .76. Representative of investigations 
m this area are those reported by Byrd," Damrin," 
and Northway.'* 

Finally, from the above survey some studies 
were found in which the interval between testings 
vaned from three months to one year (mostly three 
to five months). The median coefficient determined 
from these studies was .65. Representative of the 
studies using this longer time interval are those 
reported by Bronfenbrenner'* and Taylor." 

These figures show clearly that the stability of 
an individual s choice-status in his group decreases 
by noticeable degrees {.90..76..65) as the time in- 
terval between test and retest is increased. This is 
what should be expected since longer time periods 
allow more changes in interpersonal alignments to 
occur. Furthermore, over periods of several months 
or longer, many changes in the pereonnel of class- 
room groups may occur due to some pupils leaving 
and others coming in. 

All the above data emphasize that an individ- 
ual s choice-value in a particular group is charac- 
terized much more by stability than by fluctuation. 
A teacher may assume, therefore, that the relative 
ranks achieved by pupils in a particular sociomet- 
"^^PPjaisal are fairiy representative of the ranks 
which they will achieve from subsequent appraisal 
on the same or similar criteria. It should be recog- 
nized that this stability does not necessarily result 
from repeated choices made by the same individu- 
als. FrequenUy a real contribution of the sociomet- 
ric approach is the noting of shifts of individuals 
from clique to clique. 

THE VAIIDITY OF SOCIOMETRIC SCORES 

The validity of sociometric results depends upon 
®^ ^^^^ standpoint, when 

pupils give honest and sincere responses to a 
sociometric question, it can be said that these re- 
sponses have "face validity" in the sense that no 
one is a better judge of an individual's feelings 
toward others than is this individual himself. In 
other words, a sociometric evaluation is a direct 
measure of the kind of behavior under investiga- 
tion. When the members of a group are asked to 
state their preferences for each other as playmates, 
work associates, or roommates, and they do so 
with honesty and sincerity, their feelings toward 
each other have been measured directly in regard 
to the stated criterion. 

The second way of approaching the validity of 
sociomefric results is to assume that if they are 
measuring something that is important or signifi- 
cant about human behavior, they should show 
some relationship vdth other methods of assessing 
p^rsonal-social adjustment. Granting that re- 
in i^li*i*"*.V't* Validity "tod ConttAiicT of Choic«i 
in a Soctomatrlc Soeloaftty, mh*B\, May, 1951. ^'^w*** 

H«n*i2*^'i^;*?*."'j?* SIM and Sibling Ago, Sox, and Pool. 

iSNorthway, op. clL 
s^,.i!i??*!i Bronfanbronnar, "A ConotanI Framo of Roforoneo for 

In EUklvTr? jf' ft'^*'* Routing to Soda) Aeeoptanca 
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•ponMs to sociometrie measurements have '*{ace 
validity/' one might not be convinced that these 
responsos have general psychological or educa- 
tional significance beyond the immediate testing 
situation. The question then becomes: To what 
extent are sociometrie scores valid indicators of 
good or poor personal-social adjustment as deter- 
mined by other methods of assessment? 

This question can be answered with present 
evidence in regeurd to personality self-reporting in- 
ventories (such as the California Test of Personal- 
ity)," teacher ratings of pupils' personal and social 
behavior, pupils' ratings of each other, projective 
devices, and observational records obtained on 
overt social behavior* 

The research findings in regard to all of these 
methods of personality measurement in their rela- 
tionships with sociometrie data are very similar in 
two respects: (1) When total groups are studied, 
the relationships between these various methods 
of personality eissessment and sociometrie scores 
are not marked, but (2) when those who are high 
in choice-status (such as the upr^r fourth) are 
contrasted with those who are low, the findings 
are qxiite consistent in showing most frequently- 
chosen individuals to be reliably superior to the 
ii|frec|uently-cho8en ones in some psychologically 
and/or socially approved types of behavior adjust- * 
ments. Only in rare instances are the low-choice 
individuals found to be superior to the high ones 
In euiy desirable behavioral characteristics. 

The kinds of behavior in which sodometnirally 
high individuals are generally found to be most 
superior to the low ones are: extroverted interests, 
friendly contacts with others, positive self-regard- 
ing atUtudes, congenial relationships with parents 
and teachers, cooperative behavior, cheerfulness 
and buoyancy of mood, sensitivity to the responses 
of others, and the ed^sence of eccentric behavior 
wd bisarre thought trends. 

Representative studies which support the above 
statements are those by Baron,^* Bcnney,^** Fein- 
berg,'* Hardy,'^ Kuhlen and Bretsch," Kuhlen and 



fo/ni« U§t ol ?Mon»lity (tot AngtUt: C«liJonU« Twt But««u, 1953). 

t»p«Bit Uten, **P«tfoiial.Socl4l OttMctorittici uid a«iifoom 
Sodal Statu.: A SoclomttTic Study ol Fifth and Sixth Grada Oirii," 
Socionalrr, 14:32*42, Fabtuarr, 1951. 

a^'^Jf*^t^' ^?J?'f^»S*r »^ Socially Sueeaaaful and 

34:449-72, Navaftbar. 1943 

— .popular and Vnpopuht Chltdfn, Moaoflfaph ol tha Amarl- 
F/^.^PS^^'^**^^ Aitociation {Baacon, Kaw York: Baaccm Houaa, Inc.. 
1947). 91 i>p. 

—7 A'?^** Bahavlar X>lilaraneta batwaan Sacend Qrada Chll- 
dra» H^fh AAd tow Sociosatilc Statua," /ounial et Edu€»tionml 
ntwek, 4l:491*9$, March. 1955. 

aiMortimar K. Faldsarg, ;'IlaUtloa al Bachoround Exparianca to 
SlwM *AprlMl53 Abnetmrnl aad SocJai Pafebolcgy, 

22|taftba CrumptoB Hardy, "Social KaeegaliioB at tha Elaaia&tary 
School Aga," /ouraal oi Social PMycbotogy, 8:d6$«94, Auguat. 1937. 

33]Uyn«Bd G. KuiU« aiid Howard S. Bratach. '*Sociomatric 
Statua and Paraonal Problaitia ol Adolaacaaia." Sodoaiafry. 10:122<32. 
May, 1947. 



Ue." McEnney." Jennings." MiU.*^ Northway and 
Wigdor," Olson." and Scandrette.*** 

In a study oi forty sixth-grade class groups, 
Gronlund** has found a median correlation of ,59 
between the estimated sodometric rankings of the 
pupils made by their teachers and the actual socio- 
metric rankings obt^ned from pupil choices, this 
finding shows a mi^tontial agreement between 
the teachers' judgnlents and the pupil choices but 
is obviously not high enough to warrant the as- 
sumption that teacher estimates can be substituted 
for sociometrie data obtained from the pupils. 
Teachers are inclined to overrate the choice-status 
of certain students who may be outstanding in 
leadership roles but are nevertheless not well- 
liked. They are also inclined to overrate those stu- 
dents who display some behavior characteristics 
which are regarded favorably by most teachers 
but which are not so favorably regarded by the 
students. On the other hand, teachers are inclined 
to underrate the choice-status of students who do 
not adapt, themselves well to the academic situa- 
tion but who may, in some instances, be well- 
accepted in some of the important cliques in the 
school population. Most teachers do not have 
enough direct contact with their pupls to acquire 
much information in regard to their interpersonal 
preferences* 

All the foregoing evidence bearing on what 
can be referred to as the second approach to 
validity is important to teachers because it shows 
that pupils (on both the elementary and secondary 
levels) who are frequently chosen are practically 
certain to be characterized by memy more per- 
sonal-social assets than are those who are seldom 
chosen. Consequently, data obtadned from soci- 
ometrie testing give a teacher some important 
clues to the level of personal-social adjustments 
attained by the members of a class. 

These statements, however, must not be taken 
to mean that there is some one type of personality 
which is invariably found to be characteristic of 
either frequently-chosen or infreqniently-chosen 
pupils. There are too many individual differences 
in both these categories for any one type to.be 
clearly identified. 



24Raymoad G. Xuhlaa a&d Baatrlca |. taa. "Paraoaality Char> 
actariatics aad Social Accaptability in Adolaacaaca," /ouraai ol 
Educalloaal pMyebologr, 34:321-40. Saptaaibar. 2943. 

vsMcKlaaay, op. cH., pp. 356.67. — 

2f}|aaaiaga, op. eit. 

27Cyril R. Mill. "Paraoaality Pattaraa ol SociomatHcally Salactad 
Rajactad Mala Collaga Studaata." Socionafry. 

16:151*67, May, 1953. 

vfiMary 1.. Northway aad Bloaaom T. Wigdor. "Rorachach Pattanu 
fl*}fl*A J^* Seciomatric Statua of School Childraa." Socionafry, 
10:196*99, May, 1947. 

2»WiIlard C. OJaoa. **Improvamaat of Hutaut Ralatioaa la tha 
Claaaroom.*' C&lldjioofl Educafioa, 22:317-25. March, 1946. 

soOaaa C. Scaadratta, "Claaaroom Choica Statua Ralatad to 
Scoraa oa Compoaaata of tha CaUloraia Taat of Partoaallty," /ouraal 
0/ fducoHoaal Saaaarch. 47:291-96, Dacambar, 1953. 

stNoraiaa £. Oroaluad. "Tha Accuracy ol Taachara' Judgmaatt 
Coacaratag tha Sociomatric Statua of Sixth*Orada Pupila: Sacoad 
Part," SocToaiafry, 13:329-57, Novambar, 1950. 
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I. PURPOSE OF RKTH 



The Research Evaluation Team for Education (RETE) was formed by the Educational 
Improvement Center of Nor^^west New Jersey (EIC-NW) iniorder to assist schools and 
other educational groups in ^a^ • Juatmg the effectiveness of their work, and (b) 
conducting research relative to uieir concerns. 

RETE is a group of professionals who have backgrounds in education and psychology* 
with special expertise in testing and measurment, research design, evjiuanon, and/ 
or statis^cM^ analysis. The team functions as ar integral part of EIC-NW (see Figure 
^)». J^^vi .^nools in the six county region, evaluating the work of the Center itseit, 
and^conducting special research/evaluation projects throughout the state on a no- 
profit agreement basis. 
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H. CLARIFICATION OF RESli ARCH/EVALUATION 



RETE is designed to contribute services to ongoing projects m education, as well as to 
projects during the planning phase. In rendering these services, a distinction is made 
between research and evaluation: research involves testing hypotheses in defined setting-- 
by obtaining data within an experimental or quasi- experimental design; evaluation involves 
gathering data on the effectiveness of a given program or procedure, relative to previously 
identified goals and objectives. A more precise picture of research vs. evaluation is 
presented in Figure 2: 





Research 




Evaluation 


I 


1 


Experimental or quasi-experimental 
design is crucial. 


K 


Experimental or quasi- experimental 
design is desirable, but not 
necessary. 




2. 


Parameters defined sufficiently to 
permit generalization of findings to 
appropriate populations. 


2. 


Parameters defined sufficiently to 
facilitate decision making in the 
specific setting. 




3. 


Preference- given to pre- post test 
design, with experimental and 
control groups desirable. 


3. 


Control groups seldom used unless 
necessary for the decision making. 




4. 


Validity and reliability of tests 
are crucial 


4. 


Validity and reliability of tests are 

JjLSirabl G_butv en t£»r \nnrn_fe^T£^nni>£i^ 










tests are often more appropriate. ! 

I 


5. 


Attempt to be unobtrusive in 
testing. 


5, 


May choose a reactive measure in | 
order to facilitate a change. j 


6, 


Data withheld until final report in 
order to prevent change m treatment*. 


6, 


j 

Formative feedback given. j 


7. 


Report made public. 


7. 


! 

Data released to the d^.ion'rr..ikers ; 
for dissemination. 
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Ill ROLE DEFlNmONS 



In both research and evaluation, it is important that tfie roles and responsibilities of RETE and the 
client be clarified and accepted by both parties before the agreement is finalized, as outlined below. 



RETE 



1. Assist client in selecting those concerns which 
should be answered by the research/evaluation 
design. 

2. Assist in stating project goals and objectives/ * 2. 
hypotliescs in measurable terms. 

* 3. Develop a research /evaluation design appropriate 3. 
to the outcome of #1 and #2. 



CLIENT 

*1. Identify ail concerned groups and their 
probable questions. 



• 4. Develop cost estimates for carrying out the 

total research/evaluation design; draft terms 
of agreement. 

♦ 5. Identify and/or develop appropriate instruments 

for obtaining data. 

6. Identify sample or group to be tested. 



Identify project goals and objectives/ 
hypotheses lierived from #1. 

Examine the design for: (a) relevance to tsctual 
concerns and interests, (b) appro.-riatenej5s 
to constraintcJ within tlie setting, (c) informa-, 
tion required by RETE to conduct the rescarcli/ 
evaluation within tlie actual setting; e.g. 
facilities for gathering data, climate within 
schools, communications procedures, etc* 



4. Obtain approval from funding group; sign 
formal agreement. 

5, Examine instruments selected or developed 
by RETE and approve final format. 

♦6. Provide data for sampling (class lists, 
teacher names, records, etc.). 



* 7. Identify methods of gathering, handling, analyzing 7. Examine, suggest, and reach agreement with 
and reporting data. r£XE on procedural matters, i. e. how data 

will be gathered, yAxo will receive both raw 
^ and analyzed data, type of report required to 
meet project needs, and disposition of data 
upon completion of the project. 



♦ 8. Schedule data gathering. 



— 9. -Administer instruments, ^organlze-andiinalyz^e™ 
cata, write up report of results. 

♦ 10. Submit two copies of final report to client for 
duplication and dissemination within guidelines 
of Initial agreement; retain copy of same for 
files. 



8. Communicate research/evaluation plan to 
target.group and obtain approval at every 
level affected (parents, school board, etc.). 

"'♦9r~Tacilitate communications between RETClmd" 
specific individuals mthe sample. 

10. Disseminate final report. 



11. Make decisions as to follow-up based on the 
results of the research/evaluation. 



• This responsibility must be performed before its corresponding activity can take piac 
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IV. DEVELOPMENT OF RESEARCH/E VALUATION DESIGN 



As incUcated m the preceding section, RETE may assist the client in developing 
goals, objectives, and/or hypotheses or RETE may work with those already developed 
by the client. In either case a written preliminary design will be developed which 
will include the following specifications for ea ,h goal and objective/hypothesis: 

1. Performance to be measured 

2. Selection of participants 

3. Measurement instruments and data collection procedures 

4. Data analysis techniques 

, 5. Person(s) responsible for eacl aspect of the evaluation/research 

This design will form the basis for agreement on the work RETE will perform and 
will serve as the basis for estimating costs. 

S 

RETE will attempt to identify and manage as many of the variables within the study 
as possible. Those variables which cannot be controlled and yet are expected to 
influence results will be identified along with the report of data. - 

Although final decision as to type of experimental or quasi-experimental design 
generally lies with the client, RETE will recommend a design which involves the 
least manipuLition of and intrusion into the educational setting. However, in some 
cases, the planned treatment may recognize and incorporate expected effects of the 
evaluation process itself. In such instances, the evaluation design will be organized 
to facilitate such effects. 

Before the selection of the design .s finalized the following factors will be considered: 



1. FeasibiUt>' of obtaining data within the setting-. 

2. Anticipated effects of the measurement process on the subjects, the setting, 
and the total educational experience. 

3. Possible unanticipated effects (as above). 

4. Availability of instruments suited to the objectives/hypotheses. 

5. Time and effort required for obtaining, scoring, and analyzing data. 

6. Level of measurement that can be obtained with identified instruments. 

7. Statistical treatment appropriate to level of measurement. 

8. Constraints imposed by both the setting and RETE resources, 
y. Political implications of anticipated and unanticipated findings. 

10. Miscellaneous factors within the client's community which ma\ influence the 
feasibility of research/evaluation and the value of the findings'to education in general. 

11. Cost estimates relative to abailable funds and potential gains. 
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V. IDENTIFICATION AND CONSTRUCTION Of INSTRUiMENTS 



Instruments used by RETE to carry out a research/evaluation design will meet as 
many of the following criteria as possible. The point at which the decision is made 
to develop a measure rather than use an existing one depends on constraints of time, 
cost, etc. Existing instruments will not be used unless they satisfy the first four 
criteria. Modification of an existing instrument may be undertaken to satisfy these 
criteria with permission of the developer of the original instrument,*" 

1. Content measures the objectives/hypothesis more closely than other available 
instruments. 

2. Content and format are appropriate for use with the target population; c. g. 
reading level, cultural/linguistic/sex bias, length, etc. 

3. Evidence of reliability. 

4. Evidence of validity. 

5. Level of measurement is hi^er than that obtained with other available mstrumencs. 

6. Practicality of administration and scoring. 

7. Cost and feasibility of obtaining required number of copies. 

hi general, original instrument development will be in accord with procedures out- 
lined in the Handbook on Formative and Summative Evaluation of Student Learning 
by Bloom, Hastings, and Mandaus. (McGraw-Hill, 1971) 
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VL SAMPLIiNG PROCEDURES 



In some situations it will be both appropriate and feasible to test the entire target 
group. This will be particularly true in evaluation designs. In other cases it will 
be neither necessary nor desirable to measure the entire group. Ik such cases 
sampling procedures will be employed. 

The sample size required will be esiimated by using a standard formula which considers 
desired confidence levels, tolerable errors in estimation, and estimates of variability 
of the particular instrument used. 

Selection of the sample will be based on those characteristJics of the total population 
which RETE and the client identify as having probable influence on the results, in 
some cases, simple random sampling procedures, will be employed. In other cases, 
stratified random sampling procedures will be used, with the stratification based on 
characteristics previously identified. In general, a classroom is considered to 
be one unit, unless the school usually assigns children to classes on a random basis. 
Every effort will be made to obtain an adequate sample by Ubing the classroom unit as 
one of the factors on which sampling is stratified. Data analysis procedures will 
treat the class scores as a single unit, unless there is statistical evi<ience that the 
classes are not sigiuucantly different from each other* In such cases, the individual 
score will be considered as the unit. ^ 



Campbell and Stanley, Experimental and Quasi-Experimental Desigt is for R esearch , 
Rand McNally; Chicago, 1966. ' 
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ML DATA COLLECTION 



r)ata collection procedures will be scheduled within the specifications of the 
research/evaluation design, consistent with the following considerations: 



1- Maintenance of consistent environmental and test conditions for all groups. 

2, Awareness of and attempts to reduce sources of variability. 

^. Maintenance of professional non- judgmental stance. 

4. Maintenance of professional test and data security. 

5. Development of inf^r-personal and inter-group trust. 

6. Development and maintenance of a good image for EIC, RETE, and client. 

After the sample has been identified and approval has been obtained from the client 
these procedures will be followed: 

1. Contact between RETE and appropriate school administrator will be made. 

a. Purposes of RETE and EIC will be explained in relation to client. 

b. Discussion of which groups should be informed of research/evaluation 
procedures will be initiated. 

c. Travel directions will be obtained. 

2. Materials pertinent to data collection will be mailed or presented in a conference. 
These will include: 

a. appropriate sections of research/evaluation design 

b. RETE Policies and Procedures Statement 

c. information on specific instruments to be administered where 

* appropriate, (a copy will be given to the administrator with a request 

that the test security be maintained) 



statement of requirements for tesUng time, personnel, supplies, 
environmental conditions, space, etc. 

e. presentation of alternative means of communicating with teachers, 
students, and parents, etc. ^ 

f. requests for information pertinent to scheduling data collection.^ 

3. Follow-up procedures will include: 

a. Written statements dealing with data collection procedures wjI^ be 
sent to the appropriate parties, delineating orientation options for 
target groups, test schedules and requirements, specific instruments 
that will be used, and RETE policies for handling both raw and analyzed 
data. 

b. Written acknowledgement of receipt and acceptance of section 3a 
will be obtained* 
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c. ^ Evaluator schedules will be arranged and the administrator will be 

informed of same. 

d. Evaluator will be equipped with adequate testing supplies, directions, 
schedules, names of school personnel involved, and other pertinent 
information . 

e. Evaluator will collect data. 

n completion of data collection the following procedures will be observed: 

a. ^ETE will score, record, and analyze data analyze data according 
' -to^ design. 

b. Where appropriate, a. follow-up letter will be sent to school personnel 
^ and students. 

c. Feedback data will be organized and/or distributed according to 
research/evaluation design. 
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VIII. DATA HANDLING 



RETE will use all precautions deemed necessary to protect: 

1. the confidence given b> the person being measured 

2. the client from release of incomplete or misinterpreted data 

3. .the professional ethics of RETE members 

4. the reputation of EIC-NW as a supportive agency for schools 

5. the data from misuse in personal or political (ratiier than professional) decisions. 

In order to fulfill the above requirement RETE will: 

1. Request that no names be attached to response sheets, unless such information 
is deemed necessary and appropriate for a specific research/evaluation design. 

2. Assure participants that data will be reported in terms of groups only, with 
no specific names released if names were, if fact, obtained. 

Release names of specific subjects along with the findings only in cases where: 

a. the instrument-development and the testing situation warrant 
diagnostic interpretation 

b. the recipients of the findings are trained in proper hrterpretatioh and 
use of such data. 

c. the same child will be tested at a later date and the evaluator cannot 
easily identify the child in another way* 

4. Maintain any master list which links code numbers to names. This list 
will be kept secure and released only according to the a priori agreement 
with the client. ^ 

5. Use an instrument only for the purposes for which it was developed or as 
RETE may deem appropriate following pilot testing of that instrument. 

6. Analyze and report data only as indicated in the research/evaluation design. 

_ Negat ive findings will be reported with the same openness as positive findings. 

7. Tvlake every effort to gather information which will aid in interpreting results. 
Such information will be included in the interpretation section of the report. 
However, this inclusion will not alter that section which reports findings 

of the study. 

8. Release data only as indicated in the a priori agreement with the client. ^ 

9. Maintain all raw data for a period of one year. This data will be stored 
with codes instead of names* After one year the master list with names 
v/ill be destroyed, codes that identify groups will be retained (but other 
aspects of the code will be blotted out), and the client may the:, decide 
on the further treatment of data* Unless the client requests the raw, 
partially coded data within the second year, the data will be destroyed 
after the end of the second year. 
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IX. DATA ANALYSIS 



Data will be processed and analyzed according to the specifications of the 
instruments and the appropriate aspects of the research/evaluation design. 
In all cases, data analysis techniques will be chosen to suit the nature of the 
data with respect to sample size, degree of "normality'* predicted in the total 
population, level of measurement, and sophistication of the collection techniques 
and experimental design. 

In general, descriptive statistics will be used. However, every effort will be 
made to increase the level of measurement and the power of appropriate statistical 
techniques. Precautions will be taken against the use of statistical treatments that 
are more powerful than the data warrant. 

Analysis procedures that are not included in the original design and are decided upoiT 
after the collection of data can be conducted but will be reported as post facto analysis 
("snoop" techniques). In general, this procedure will be avoided unless truly 
significant information for further study might be lost. 
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X. PREPARATION AiND DISTRIBUTIOiN OF REPORTS 



RETF will prepare reports only for those aspects of the research/evaluation" design 
for which RETE was designated as responsible in the a priori agreement with the 
client. In all cases the client is expected to communicate with RETE the expectations 
of the funding agency in so far as style, format and makeup of report is concerned. 
RETK will then follow these guidelines in development of those aspects of the report 
which describe RETE generated research/evaluation procedures, findings, and 
implications. The client will write all other aspects of the final report. 

The client will receive two copies of the RETE report, suitable for duplication. 
A third copy will be retained by RETE. (Arrangements for duplication of the 
report in quantities can sometimes be made with EIC-NW on a cost basis. These 
arrangements must be made separately from the original contract agreement.) 

Reports shall include due credit to all resources which were utilized in the research/ 
evaluation project, i. e. , authors or developers of tests, persons who facilitated the 
study, pertinent staff of the client's program or organization, and RETE members 
who participated in the study. Unless arrangements are specifically made to the 
contrary/, RETE may duplicate and distribute the report or sections of the report 
to organizations or individuals who request assistance with similar research/ 
evaluation projects or examples of the types of work done by RETE membejs. 
Copies of letters to requesting groups or-the fiames of these groups or individuals 
will be regularly supplied to the client, if such an arrangement is specifically made. 
Arrangements may also be made with the client in v^ich specific sections of the 
report are designated as 'tor client use only^and not for inclusion in any materials 
distributed by RETE. 



The general principles to be followed are maintenance of professional ethics and 
trust between the client and RETE. 
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Evaluation Design 



IGE - New Careers in Education 
I 



GOAL I 



Goal: As a result of state network implementation by the New Careers in 
Education Office, first and second cycle elementary schools meeting 
minimum IGE implementation criteria will produce significant changes 
in student learning. 

1.1 In comparison with children in control groups, students in 
IGE classrooms will show significantly greater achieveinent 
in reading and/or math as measured by a standarized achieve- 
ment test. (Reading and/or math will be measured as 
appropriate to the implementation process in the specific 
schools in the study. ) 

Performance to be Measured 

Student achievement in reading and/or math. 

Selection of Participants 

A random sample of schools will be drawn from those first and second cycle IGE 
schools that are implementing reading and/or math within the MUS-E design. 
Students will be sampled within the identified schools. A matched sample of 
students not attending an IGE school will be drawn to serve as a control group 
for the purposes of this study. . 



Measurement Instruments and Data Collection Proced ures 

Appropriate batteries of the Stanford Achievement Tests, 1973 edition, will be used 
to measure achievement in reading and/or math. (The subject area will be determined 
by the implementation process in each school in the study. ) The students in both the 
IGE and the control groups will be tested in February, 1974, to allow for maximum 
exposure to the IGE/non-IGE experience. 

Data Analysis Techniques 

Scores from IGE and control schools will be analyzed with a_t-test for differences 
between means. A second level analysis will be accomplished, using the judgments 
of IGE facilitators, to compare differences between schools that are 
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highly successful in implementing IGE procedures with those that are not. 'W' 

Non-parametric statistics will be used to analyze these differences. A 0. 05 level 

of significance will be utilized. * 

1.2 In comparison with children in control groups, students in IGE 
classes will demonstrate significantly more positive attitudes 
toward school. 

Performance to be Measured 

Student attitude toward school. 

Selection of Participants 

The same IGE and control populations that participate in the reading/math achievement 
testing (indicator 1. 1) will participate in this aspect of the design. 

Measurement Instruments and Data Collection Procedures 

A RETE-developed instrument . ATCA, will be administered to measure any differences 
between students in IGE and control schools with respect to their attitudes toward school. 
The ATCA was adapted from work done at the Institute for Educational Research 
Downers Grove, Illinois. (See Appendix. ) 

Data. Analysis Techniques 

Total scores will be analyzed using a ^-test for differences between means. A 0.05 
level of significance will be utilized. 

Person(s) Responsible for Evaluation 



Research Evaluation Team for Education (RETE). Dr. Karen Todd. Director. 



ERIC 67 





1 

COAL 11 




Goal; As a result of state network implementation by the New Careers in 
Education Office, first and second cycle elementary schools meeting 
minimum IGE implementation criteria will show characteristics which 
are likely to facilitate long-term commitment to the IGE process. 




2. 1 Expenditures will shbw no significant increase for start up and 
maintenance costs. 




Performance to be Measured 




Amount and use of those funds available to the building principal of an IGE-MUS-E 
school, (i.e., whether the school, functioning within the IGE-MUS-E design is 
actually more costly to operate, or whether only a redistribution of monies is 
required. Areas under question will include hiring of para-professionals, unit 
leader compensation, relased time for teachers, and instructional materials.) 




Selection of Participants 




All first and second cycle IGE schools as identified by the New'Careers in 
Education Office. 




Measurement Instruments and Data Collection Procedures 




A data collection form will be mailed to each IGE building principal asking him/ 
hereto identify cost items such as those listed above as they relate to current 
expenses and expenses for the one year prior to IGE implementation. The instru- 
ment will be mailed to principals in spring, 1974, to allow for inclusion of data 
from the current academic year. 




Data Analysis Techniques 




Each item of the survey will be analyzed and tabulated. Descriptive statistics 
will be used to report findings. 




Person(s) Responsible for Evaluation 




Research Evaluation Team for Education (RETE), Dr. Karen Todd, Director. 
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2.2 Pupil absenteeism will show no significant increase from previous years. 
Performance to be Measured 

Pupil absenteeism in first and second cycle IGE schools. 
Selection of Panicipants 

Records on student populations from all first and second cycle schools will be 
mcluded. 

Measurement Instruments and Data Collection Procedures 

A data collection form will be mailed to each building principal soliciting statistical 
data relative to pupil absenteeism both presently and prior to IGE implementation. 
The instrument will be mailed to principals in spring, 1974. to allow for inclusion 
bj R^Te""" '"''''^"^ academic year. This form is currently under development 

Data Analysis Techniques 

Descriptive statistics will be used to report findings. 
Persoi-i(s) Responsible for Evaluation 

Research Evaluation Team for Education (RETE). Dr. Karen Todd, Director. 

2. 3 Teacher attendance and turnover will show no significant change from 
previous years. 

Performance to be Measured 

Teacher attendance/absenteeism. Incidence of teacher turnover. 
Selection of Participants 

Records for teacher populations from all first and second cycle schools wi.' be included. 
Measurement Instruments and Data Collection Procedures 

A data collection form will be mailed to each IGE building principal soliciting statistical 
data relative to teacher attendance and turnover both presently and in the one year 
prior to their IGE MUS-E implementation. The instrument will be mailed to principals 
in the late spring, 1974, to allow for inclusioi of data from the current academic year. 
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Data Analysis Techniques 

Descriptive statistics will be used to report findings. 
Person(s) Responsible for Evaluation 

Research Evaluation Team for Education (RETE), Dr. Karen Todd, Director. 

2. 4 LEA'S will be able to assess the effectiveness of the IGE progress 
at the local level. 

Performance to be Measured 

Community support for IGE. Locally selected aspects of the RETE-NCE evaluation 
design. 

Selection of Participants 

Any LEA which is p 'rticipating in the New Careers •• IGE project and has 
not been designated as participating in the RETE-N "^E evaluation design. 

Measurement Instruments and Data Collection Procedures 

Names, sources, and background information on instruments RETE will 
employ, as well as an instrument appropriate to measurement of community 
attitudes toward IGE, will be included in an evaluation procedures packet. 
This [jacket will be made available through the New Careers in Education OfficP 
All or part of this packet may be employed by the Ll-A's at their discretion. 

Data Analysis Techniques 

Analysis techniques employed will he determined by the LEA, with guidelines 
supplied in the packet. 

Person(s) Responsible for Evaluation ^ 
To be determined by the individual LEA's. i 
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GOAL III 



Goal: A system will be developed and operative whereby the implementation 
process of IGE can be monitored and expanded by the New Careers in 
Education Office. 

3. 1 75% of IGE league members who request assistance from the 
New Careers in Education Office will indicate that the NCE 
Office did provide assistance that was appropriate to their 
problem. 

Performance to be Measured 

Assistance provided by the New Careers in Education Office to IGE league members. 
Selection of Participants 

All members of the IGE leagues will be asked to provide feedback data with respect 
to assistance received from the New Careers in Education Office. 

Measurement Instruments and Data Collection Procedures 

A data collection form developed by RETE will be used by the NCE Office to obtain 
appropriate feedback from league members. 

Data Analysis Techniques 

Descriptive statistics will be used to report findings. 
Person(s) Responsible for Ev aluation 

Designated personnel in the New Careers in Education Office 

3.2 80% of the areus of concern reported to facilitators and 
recorded on the school visitation summary will be followed 
through by the New Careers in Education Office with appropriate 
action at the HUB or league level. 

Performance to be Measured 

Response by the New Careers in Education Office to facilitator reports. 
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Selection of Participants 

Personnel in IGE schools who relate their concerns to league faciltators. 

Measurement-Instruments and Data Collection Procedures 

School visitation summary forms completed by league facilitators will ^ 
used to record the concerns communicated to them by IGE school personneK"^ 
Evidence of action taken will be documented in NCE Office records, * jL 

Data Analysis Techniques 



Descriptive statistics will be used. 
Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 

3.3 75% of the principals from IGE schools will indicate at least 
three specific examples of how a facilitator helped in the 
implementation of this program* 

Performance to be Measured 

Facilitator assistance to principals of IGE schools with respect to the IGE 
MUS-E implementation process. 

Selection of Participants 

All principals of IGE schools will be asked to provide examples of facilitator 
assistance in the implementation process. 

Measurement Instruments and Data Collection Procedures 

Feedback forms developed by RETE will be mailed to IGE school principals to 
solicit appropriate feedback information. 

Data Analysis Techniques 

Des,criptive statistics will be used. 
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Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 

3.4 Each league chairman will be able to indicate at least two 
specific examples of how a HUB meeting helped solve a 
specific problem for him. 

Performance to be Measured 

Effectiveness of HUB meetings as problem- solving vehicles for league chairman. 
Selection of Participants 

All league chairman will be asked to provide feedback data on HUB meetings. 
Measurement Instruments and Data Collection Procedures 

A data collection form developed by RETE will be used by the NCE Office to solicit 
appropriate feedback from league chairman, following HUB meetings. 

Data Analysis Techniques 

Descriptive statistics will be used to report findings. 
Person (s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 
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GOAL IV 

Goal: 100% of the .15 third cycle school districts undergoing a clinical 
training approach will met minimum IGE implementation criteria 
June, 1975. 

4.1 By October 30,1973, at least 15 school districts will request 
to take part in a pre-clinical workshop. 

Performance to be Measured 

Number of school districts requesting to participate in a pre-clinical workshop. 
Selection of Participants 

N.J. school districts that select themselves by requesting to participate. 

Measurement Instruments and Data Collection Procedures 

Records of request coming into the New Careers in Education Office. 

Data Analysis Techniques 

Total number of request will be reported. 

Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 

4.2 By December 31, 1973, at least 15 school districts will have 
submitted a formal application with documentation evidence 
and will have met the standards of the New Careers in 
Education Office for IGE participation. 

Performance to be Measured 

Number of school districts submitting formal application and documentation 
evidence and meeting standards of the New Careers in Education Office for 
IGE participation* , , 

Selection of Participants 

N.J. school districts that select themselves by following application procedures 
and meeting NCE criteria for IGE participation. 
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Measured Instruments and Data Collection Procedures 

Records of application procedures and criteria for IGE participation as 
maintained by the NCE Office. 

Data Analysis Techniques 

Total number of applicants who meet minimum criteria will be reported. 
Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 

4.3 By the end of the clinical workshop, 100% of the principals 
and unit leaders will score 80% or higher on a test of IGE 
knowledge and skills. 

Performance to be Measured ^ 

Knowledge of IGE application and skills, 

Selection of Participants 

Pricipals and unit leaders identified by their respective school districts to 
participate in a clinical workshop. 

Measured Instrument and Data Collection Procedures 

The IGE Cncepts Test by Mary Quilling and Juanita Sorenson from the Wisconsin 
Research and Development Center for Cognitive Planning will be administered 
by personnel from the New Careers in Education Office. Each section of the 
instrument will be used to ascertain knowledge acquired during a corresponding 
module of the ten day- clinical workshop. . 

Data Analysis Techniques' 

Subtest scores for each workshop participant will be totaled to determine the 
level of mastery achieved by each principal and unit leader, and the percentage 
of correct answers will be calculated. The percent of participants who score 
80% or higher will be determined. 

Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 
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4, 4 By the end of their clinical experience, all participating schools 
will have met the first two criteria for an IGE school and will 
have evidence that they are working toward tlie third criterion. 

Performance to be Measured 

Satisfaction of criteria as a Multi-Unit School (MUS-E) on the organizational 
level, including a functioning Instructional Improvement Committee (IIC). 
Evidence of movement toward implementing IGK in at least one subject area. 

Selection of Participants 

Schools whose personnel have participated in tiie clinical workshop. 

Measurement Listruments and Data Collection Procedures 

Facilitator school visitation summaries and observations will be used to 
validate the schools* satisfaction of the above stated conditions. 

Data Analysis Techniques 

Descriptive statistics will be used. 

Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 
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GOAL V 
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Goal: By June 1975, seven middle schools will meet minimum ICE implementation 
criteria. 

5. 1 By July 1, 1973 at least seven middle schools will request to take 
part in a pre-clinical workshop. 

Performance to be Measured 

Number of school districts requesting to participate in a pre-clinical workshop. 

£ 

Sglccti on of Participants 

N.J. school districts that select themselves by requesting to participate. 

Mea surement Instruments and Data Collection Procedures 

Records of requests coming into the New Careers in Education Office. 

Data Analysis Techniques 

Total number of requests will be reponed. 

Pcr son(s) Responsible for Evaluation 

Dcsipiated personnel in the New Careers in Ectucation Office. 

5. 2 By September 30, 1973 at least seven middle schools will have 
submitted a formal appliaition with documentation evidence, 
aftd will have met the standards of the New Careers in Education 
Office for IGE participation. 

Performan ce to be Measured 

Numlicr of school districts submitting formal application and documentation 
evidence and meeting standards of the New Careers in Education Office for 
IGK participation. 

Selection of Participants 

N.J. school districts that select themselves by following application procedures 
.md meeting NCE criteria for IGE participation. 

M ca.surcmcnt Instruments and Data Collection Procedures 

Records of application procedures and criteria for IGE participation as 
maintained by NCE Office. 
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5, 3 By the cnc® iluMt clinical workshop, 100% of tlie principals and 
unit leaders will score 80% or higher on a test of IGE knowledge 
of application and skills. 



Performance to be Measured 



Knowledge of IGE application and skills. 
S election of Participants 

Principals and unit leaders identified by their respective school districts to 
participate in a clinical workshop. 

Measurement Instruments and Data Collection Procedures 



The IGE Concepts Test by Mary Quilling and Juanita Sorenson from the 
Wisconsin Research and Development Center for Cognitive Learning, 
adapted by RETE for use with miiidlc schools, will be administered by 
personnel from the New Careers in Education Office. Each section of 
the instrument will be used to ascertain knowledge acquired during a 
corresponding module of the ten day clinical workshop. 

Data Analysis Techniques 

Subtest scores for each workshop fxirticij^ant will be totaled to determine the 
level of mastery achieved by each principal and unit leader and percent of 
mastery will be calculated. The percent of participants scoring at the 80% 
level or above will be calculated. 



Person(s) Responsible for Evaluation 



Designated personnel from tlic New Careers in Education Office, 

5.4 By the end of their clinical experience, all participating 

schools will have met the first two criteria for an IGE school 
and will have evidence that diey are working toward the 
third criterion. 



Performance to be Measured 
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Satisfaction of criteria as a Multi-Unit School (MUS-E) on the organizational 
level, including a functioning Program Improvement Council (PIC). Evidence 
of movement toward implementing IGE in at least one subject area. 

Selection of Participants 

Schools whose personnel have participated in the clinical workshop. 
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Measurement Instruments and Data Collection Procedures 

Facilitator school visitation summaries and observations will be used to 
Validate the schools* satisfaction of the above stated conditions. 

Data Analysis Techniques 
Descriptive statistics will be used. 
P ^son(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 
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APPENDIX A 
LETTERS OF TRANSMITTAL 
RETE Survey Instrument 
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EDUCATIONAL IMPROVEMENT CENTER 
of 

NORTHWEST NEW JERSEY 



halko drive 
cedar knolls, n.j. 07927 
201-539-0331 



o^K^y ^"PV'yoVf, school has been identified as one of those IC.F. 

/^-^ participatina in the 1973-74 IGE evaluation 
f^^ vA 2- fttT.'^f^ developed by the Research Evaluation Team 
for Education (RETE) in cooperation with the New Careers in 
Education Project. Every effort was made to meet the needs of 
JJ^^FhS"'!? u^^^® requirements as well as those of the 

schools whose boards of education and communities have 
been asking for hard data on IGE outcomes. 

^^^^^U ^® testing a sample of students in your school in both the 

domains and then comparing their scores as a 
group with those of students in non-IGE control schools. The 
purpose IS to determine if indeed there is a statistically signifi- 
f^^^J^^f^i-!!'^? between the two groups. (At no time will individual 
?f2 consideration.) RETE will administer the 

i J ^""^ ^^^M^^^ Toward Classroom Atmosphere (ATCA) , 

?n^«" i ^"^^ paper inventorrTiami^n^IH-orTTmr^a pproxlmate ly 
30 minutesK as well as appropriate batteries of the Stanford . 

J^nJir®';^'^--^-'.^^^? edition. Reading and/or math batteries will 
De used, (administration time of 65 and 50 minutes respectively) 
depending on the implementation process in your school as indicated ■ 
in the New Careers Pertinent Data Bulletin. 

In order to accomplish this testing with minimal disruption to you, 
inf^r^^Hnn*J« ^"""l students, I am asking you to return the following 
information to me February 1. It is most important that I 

in°Feb?ua^y^^ ^^^^ testing can be scheduled for sometime 



Research Evaluation Team for Education 



1> A roster of students in your school who are between eight and 
ten years old and are in their second or third year of school 
^^yo"<^ kindergarten. Please list them accordino to this format t 

iiSSlS. Year in School beyond Kindergarten nnit T.paricr 



) A list of those dates when testing cannot take place in your 
school (e.g. school vacations, etc.!"^ 

) A time schedule, Indicating your school hours, lunch times, 
special teachers, etc. i.e. those reaular times when testing 
would be unmanageable. 

) Travel directions to your school building from the most convenient 
major artery. 



I will be getting in touch with you during the first week in 
February to finalize the testing schedule. 

Thank you for your cooperation. 



Sincerely yours. 



Diane D. Weintraub 



DDW/kdb 
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EDUCATIONAL IMPROVEMENT CENTER 
of 

NORTHWEST NEW JERSEY halko drive 

cedar knolls, n.j. 07927 
201-539-0331 



February <■; , ' )74 



The New Careers In Education Project has contracted with the Research Evaluation Team 
for Education (RETE) of the Educational Improvement Center/NW to design and Implement 
(MUS-Er' ^ °^ '^^ (Individually Guided Education) In the Multi-Unit School 

»V • 

The evaluation la based on a control j»roup design, with thirty-three IRE schools being 
matched with non-IGE schools that are comparable in student enrollment, staff size and 
equalized valuation of the community. 

The focus of the evaluation Is student outcomes In both the affective and cognitive 
doaalna. As is the case with any educational innovations, we are ultimately interested 
in what differences a new program will make for students. I am, therefore, asking 
you to cooperate with us by participating in the study as a control school. 

Specifically, a RETE person will come into your school and test b^.tween ten and 'twenty- 
five students. These ehJldran will be selected at random by our test administrator 
at the time of testing, using a table of random numbers and your school roster of 
second and third graders. This testing must be completed by March 1. 

Testing will take approximately 1% hours ^and will include the following Instruments: 

1. Attitude Toward Classroom Atmosphere (ATCA) This is a pencil and paper Inventory , 
which RETE has developed, based on work done in a Title III project in Downers 
Grove, Illinois. It consists of 30 statements with which the stud-int may agree 
or disagree. 

2- Stanford Achievement Test. 1973 edition. RETE will administer either the reading 
or mathematics battery, depending on the IGE implementation process in your 
matching school. 
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Let me assure you that strictest confidence of data will be maintained. Neither 
Individual students nor schools will be Identified at any -time by name. Rather 
data analysis and reports will combine data from all control schools for comparison 
with data from all IGE schools. It Is only through the cooperation of educators 
such as yourself that responsible research can take place In "real world" settings, 
supplying those who make educational decisions with the best possible Information. 

Please respond by returning the section below as soon as possible. I will be getting 
in touch with you shortly to make more specific arrangements. Tf vou have any questions 
reel free to contact me at the Center. 




ncerelv yoiirs, 



Diane D. Weintraub 




School 
Address 



Phone 

Principal ^^^^ - 

We will participate in the RETE evaluation of the IGE/MUS-E proerain. 

We will not participate in this study because , 
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EDUCATIONAL IMPROVEMENT CENTER 
of 

NORTHWEST NEW JERSEY 



halko drive 
cedar knolls, n.j. 07927 
201-539-0331 



Memo to principals: [ 

tL'-MfJl'r"^"! ;*^*p!?T conversation, I am sent'inp you the below 

^f "^J^^/hlch you vWll reaulre for proper Implementation of 
student testing within the TOE evaluation deslpn. 

iJ'\^\ students who were randomly sampled from vour ICE unit rosters. 
.llfli alternate names to be used In the order listed In the 

event that one or more of the Identified sample Is absent. 

an outline of the simple random sampling; procedure you should use to Identify 
students to be tested in your school 

administrator Instructions for the Piers-Harris Self-roncept Scale 

Plers-Har rls Self-Concept Scale test booklets 

administrator Instructions for the Stanford Achievement Test 

Stanford Achievement Test booklets from which you should use only the tests 
Indicated: 

. Reading .£ Mathematics 

^Vocabulary (Test 1) Math, concepts (Test 

Reading (Test 2, Parts A & B) Math computation (Test 



a testing log to be completed and returned to ne &lon% with the test Instruments 



As I indicated to you. testing should take place on two consecutive moriiin^s durlne 
J?^«rHL°f ^ a\' ll c' ^! ^'"P"'^"': ^hat you administer the Piers-Harris on the 
"SfffJf «? y I ^iaa^Srd on the next day. It Is preferable that both testing 
sessions take place in the same setting with the same examiner. 

We are asking that the students put their names on both'lnstruments so that we mipht 
Investigate a possible correlation in scores on the two Instruments. Thus the same 

5°^^f « Instruments. Let me assure you that at no tlr-e will arv 

Individual data be released. 

I would appreciate your returning all test materials promptly followlnf* testing. T 
win anticipate receipt of all such materials by Wednesday, March 13. 

PTHANK YOU. 



Research Evaluation Team for Education 
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EDUCATIONAL IMPROVEMENT CENTER 
of 

NORTHWEST NEW JERSEY 



TESTING LOO 



halko drive 
cedar knolls, n.j. 07927 
201-539-0331 



To the principal: Please fill out this form and return to ne with the completer^ 
test materials. 



School : 
Address: 



Principal: 





Plers-Harrls 
Self-Concept- Scale 


Circle : Readings Math 


Date of Testing 






Time of Testing 






Test Administrator 






Number of students tested 







Did you encounter any difficulties Implementing the random sampling procedtire? 
No Y^s 



If yes, please Indicate: 



Where there any unusual conditions or clrcimistances which may have affect the testing? 
No ^ Yes 



If yes, please Indicate: 



Additional Comments: 



f==< 
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EDUCATIONAL IMPROVEMENT CENTER 
of 

NORTHWEST NEW JERSEY halko drive 

cedar knolls, n. j. 07927 
201-539-0331 



1 am pleased to report to you that the collection of student data for the evaluation 
of the IGE/New Careers In Education Project has been completed. I want to thank 
each of you for the cooperative effort that went Into the expediting of the necessary 
testing In view of the gasoline crisis that sharply curtailed our field activities. 
It was my pleasure to speak with each of you on the phone and find you so receptive 
to dealing with the situation at hand. I would welcome any opportunity to meet 
the people behind the voices. 

RETE is presently scoring and analyzing the data generated by the Instruments. Some 
800 students participated in the two testing sessions, so the task is quite massive. 
Feedback will not be available before May 1, at which time the data will be reported 
in terms of the experimental and control groups, with no individual students or 
schools being identified. 

Again, our gratitude goes to you and to your staff. 




Diane D. Weintraub 



f 
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EDUCATIONAL IMPROVEMENT CENTER 
of 

NORTHWEST NEW JERSEY halko drive 

cedar knolls, n. j. 07927 
201-539-0331 



Dear IDE Principal: 

fn^AMf n°*'K °?"3lderlng Implementation of IGE/MUS-E need 
information on both start-up and malntalnence coats. The 
following form has been designed to elicit such Information from 
?n a form as possible. Your cooperation In 

Sr«Ja?fd! *PP^°P^^ate sections promply „iii be greatlj 



as Closely as you can and respond to each question f"ly! 



Where Indicating changes. Include only those that are dlrectlv 
associated with the lOE/MUS-E ImplimiHtatlon. Thole th^t reflect 
S'el^eai^'Aere"?'"'""' '''' community, Inf iSt°?:n!'tJcyf arf 

lS«nff rLH°K * ^"^7 ?^ this cost data (no schools will be 
Identified by name) to be Included In the RETE report for New 

Friz? M^v^n^'iS"'.**" completeffJras by 

Friday, May 10. Thank you for your cooperation. 

Implementation/Maintenance Costs - lOE/MUS-E 

Descriptive Information 

1. Person completing this form 

Name Position 



Name of School — — School district 

_^^_^-J^i^e5T^ Phone 




ERiC 



How many elementary echools are there In your district? 
SeaJ^1973^1974r"^ ^""^ Implementing lOE/MUS-E as of school 

Check the school year In which your school building first 
Implemented lOE/MUS-E* ^^-"-"AnK lirst 



1971-72 



1972-73 



1973-7^» 



V/hat degree of autonomy do you (and your IIC) have In the 
following budget areas: 

coDUDlete 

Instructional materials 1 2 3 4 5 



Equipment 
r.taff positions 



1 
1 



2 
2 



3 
3 



4 
4 



5 
5 



Research f:vriluation Team tor (diKation 
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FORMULAE: 



A* t-test (yncorrelated data) 
1. separate variance t mode}: 
t = x-j - X2 



sf + s 



2. pooled variance t model: 

t = X - X 

_J 2 

2 ' 2 

(n^^ - 1) + (ng - 1) / 1 ^1 

+ - 2 \ "l . "2 



B. F ratio 



c 2 



where 



F- the value by which variance homogeneity will be tested 
2 

= the greater/ larger sample variance . 

f 

- the lesser/smaller sample variance 

degrees of freedom = I (n * 1), . (n - 1) | 

LI* larger," smaller I 



C. Selecting the t model and degrees of freedom 

1. When n-, = n, and o? = 

12 12 

Use separate or pooled variance formula with 
degrees of freedom equal to n. + n - 2 (Both 
formulas are algebraically equivalfent when 

"i = "2' 

2. ^When 4 n^ and 0^^ = o^^ 

Use pooled variance formula with degrees of 
freedom equal to n^ + ng" 

3. When = ng and o-^^ ^ 0 ^ 

Use pooled variance formula or separate variance 
formula with degrees of freedom in each instance 
equal to n^ - .1 or ng - 1. (Do not use df = n^ + n - 2) 

4. When 4 n^ and 0^^ f 0^ 

Use separate variance formula with tabled t value 
for a given level of significance determined by 
averaging t values for (a) degrees of freedom equal 
to n^ - 1 and (b) degrees of freedom equal to n2 - 1. 



ERIC 
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Stanford Achievement Tests 



'J 
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Administrator Directions 



Stanford ^chleveInent Test 



Ale^: The test booklets vou have received Include several rests. You are to 
administer only those checked below: 

Reading 

. Test 1: Vocabulary - 20 minutes 

Test 2: Reading Part A 20 minutes 

Part B 25 minutes 

Mathematics 

Test A: Mathematics Concepts - 20 minutes 

Test 5: Mathematics Computation - 30 minutes 

lou ^inut'^^ir'"r' for actual test-^takln^ time only. In vour scheduling 

vou should allow for a rest period, start-up time, directions, etc. 

Materials 

Administrator directions 
Test booklets 

Pencils (All students should be provided with #? pencils since these tests will be 

scored by machine,) 
Timing device (wall clock is fine) 

Procedure 

Ln^c^^llTl.''^VT f '^'^ arfntlnlstrntor directions and th^ test 

booklets so that you wll] feel comfortable with the wMole procedure. 

Llf ^nt^St ^""'^J'*""^ °^ environment, e.e. adequate nun,ber of chairs 

(well-srnrod). comfortable wrltlne surface, adecuate lighting, room temperature, etc. 

3. Be prepared with extra pencils 

••Thl^^^r' distributing the test booklets, vou should explain to the children that: 
rh .s set of tests is part of the same prolect that we talked about vesterdav. Once 

liTl^< ■ ! I different from vesterdav's however, in that this one deals 
with things you have learned In school. "^^ajh 



"T » 



III T/T 'V^^^ "'^"^ ^ ^"^''^^^ "^^^^ "-^"y Interesting thlnRS In It for 

you to do. Do not onen the book or mark nn it until I tell you to do so." 



Pass out booklets, 



ShoHhe sJuSeht^?^ r 11 'f? ^""'^ """'^ ^"^ information." 

Puon Inf^^^^M n °^ ^"^''^ '^^^ '^'•^"''h 'he completion of the 

Pupil Information Box, Since these booklets will be machine scored, please have them 
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complete the computer information grid according to these directl 



ABOUT MACHINE SCORING 

1* Marhino-scorablo booklets mn.st have the informa- 
tion Krid lilled in. Directions are as follows. Coiio in 
the name block below the Pupil Information !>ox. 
Notice that there are columns labeled *'Last Name/* 
•'First Name." and "M." In the boxes at the bottom 
of the part labeled "Last Nanie.'* print as many letters 
of the pupil's last name as yon can. I-.se on^ box for 
each letter. Do the same for his lirst name. Print his 
middle initial at the bottom of the *'M*' column. Then, 
in the column above each box. (ill in the circle with the 
letter which you have printed at the bottom of the 
column. Be sure that there is one and only one circle 
marked in each column. Fill in the top circle (no let- 
ter in it) in every column in which no letter has been 
printed in the box below. 

Now look at the part headed "Date of Hirth.*' at the 
riKht of the name prrid. In the column labeled "Month." 
fill in the circle next to the month in which the pupil 
was born. In the column labeled "Day.** mark the day 
on which the pupil was born; if he was born on the 
25th. you would till in the circle with "2** in the left- 
hand column and the circle with *T}*" in the riprht-baiid 
column. In the "Year" column, nuirk the circle show- 
ing the year of the pupil's birth. If he was born in 
WhW, y(ui would mark "0** in the left-hand column 
and "1" in the ri^ht-hand column. Finally, in the 
sf)ace next to "Year," fdl in the circle next to **Boy" 
or "(iirl." 

2. iMir accuracy in scoring, niachinc-scorable booklets 
nuist be properly marked with a .soft-lead (No. 2) 
pencil. AnswH»r spaces should be filled in with heavy 
(hirk marks. t'HAYONS MUST NOT HE USED ON 
ANY VAHT OF THK TKST ROOKLKTS INCLUD- 
INU; THK FRONT AND HACK COVERS. 

3. Do not bend. fold, or clip the booklets because they 
1 must be in good condition to be scored accurately. 



If vou prefer, you may have someone In your office fill In all of this Infomntlon 
prior to testing. In which case you would distribute the booklets by name. Another 
fnJ^^r r '° ^'^''^ children complete the Pupil Information Box themselves 

and then have a secretary transfer the Information to the computer box. vou may 
implement thls__proct>ss in the most convenient manner for you and your students. 
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Now turn your booklet over so that the picture on the cover is on ton. 

For Reading i,, , . t . . , . 

Marttnie-sconihte booklctH require that pupils' 

names be eiitrrcd at the top of the even- 

aumlnred pages, Directionii for this appear 

throughout the test ami are marked with ait 

asterisk. When using haml-^^eorahle booklets, 

ignore these directions. 



FIRST HALF DAY 



Before Beginning the Test 



1. To asHure quiet and freedom from interrupiiijns, 
post the "resting Do Not Disturb*' si^^n on the door. 

2. Seat pupils in such a way a.s to prevent thoni from 
helpiuK each other. Otherwise, a true picture of pupil 
achievement or pupil diHieulties CcUinot be obtained. 

3. He sure that the di'sks are cleared antl that each 
pupil has one ur two soft-lead pencils (No. 2). 

4. r.e sure you ha\e a test booklet for each pupil and 
an extra bookkt for yourself to use when demon- 
i^tratinKdirectinn^.alon^^ with these Teacher's Direv- 

-twus for Adonnistering, 

5. In oruer to time tests accurately you should have 
a stopwatch or a watch or clock with a second hand. 

First Testing. RMod 



TEST 1: Vocabulary 

SAY to the pupil:* : 

I am going to give each of \ou a booklet which has 
many interesting things in it for you to do. Do not 
open the book or mark on it until I tell you to do .so. 

Pass out the f)Ooklets, nuiking sure that each child gets 
the booklet with his name on it. THEN SAY: 

Turn your lHH)klet over so (hat the picture on the 
cover Is on top* 



Hold up a booklet and point to the picture. THEN 
SAY: 

First, we're going (o see how many words you know. 
Open your book and fold the cover back, like this, so 
that <mly page 2 is showing. See the 2 at the bottom 
of the page. Now look at the top of page 2.'*' Write 
your name at the top of the page where it says 
"Name.*^ 

Hold up a booklet and point to the name blank. Give 
help in following these instructions to any pupils who 
need it. THEN SAY : 

Put your finger on the box called "Sample'' at the 
top,of the page. It says, "puppy, kitten, cub.*' 

Point to the sample in your own booklet or copy it on 
the boar^l and point to the board. Check to see that all 
children have located the sample. THEN SAY : 

I will read part of a sentence, followed by three 
words. You will try to figure out which one of these 
three words completes the .sentence. Ready? "A 
baby cat is a —puppy, kitten, cub." Which word 
best completes tiie sentence? 

Wait for the class to answer. 

Yes, "kitten,** and you can see that the space under 
"kitten" has been marked* 

On the board, show pupils how to mark an answer 
space. Make sure all children know what to do. THEN 
SAY: 

Right below this box is line number 1. We will do 
this line and the others on this page the same way 
as the sample. I will read part of a sentence, followed 
1>y three words or groups of words, and repeat the 
sentence and the words once. One of the words or 
groups of words will give you the answer that com- 
pletes the sentence correctly. You will mark the an- 
swer space finder the word (or group of words) you 
choose as the right answer. 



Directions for Administering Vocabulary Form A 



1 ST 1: Vocabulary (Continued) 

P-" sure to read each Item number: then read each 
s ntence and the option words exactly as stated and 
rei)eat once. Occasionally remind the children to 
mark the answer space« Pause about ten seconds be- 
f re going on to the next Item, 

Proceed deliberately but steadily. Usually the 
:Y Idren will need no more time than is provided 
t a steady double- reading of each item. The 
purpose of reading each Item twice is to give 
t^em ample opportunity to follow the sequence 
c ,thre6 words and to locate the correct word. 
Continue through the entire test, encouraging 
the pupils to do the best they can, even though 
t a words may seem difficult. 



1 If you stay overnight, you stay unti 
evening ^ tomorrow 



2 A thief Is a person who 
spies ' steals 

3 To go on Is to 
continue concern 

4 A chore Is a small 

Job business 

5 Someone who Is polite has good 
luck wishes 

6 If an answer Is exact, it^is 
a guess just right 

7 A ton is a measure of 
weight time 



dinner 
thinks 
consist 
river 
manners 
difficult 
power 



8 If the way a person acts is odd, it Is 
regular natural strange 

9 Foolish talk or acth^n Is 

debate cleverness' nonsense 

'0 If you obtain a reward, you 

hate it , lose it get it 

11 A grave danger Is 

unimportant serious routine 

12 Words saying, you are sorry are 

an apology a defense a pardon 

13 A large, flat dish for serving food Is a 
^owl mug platter 

^i^Jj^ two things are connected, they are 
separated joined divided 



9B 



15 To sprout means to begin to 

shower drip grow 



16 A bundle Is a 

package pair 



barrel 



17 If you're uncertain, you're not 
..trusted willing' sure 



18 Velvet Is a kind of 
cheese vegetable 



cloth 



Now go to number 19 at the top of the 
next column. 

Make sure all pupils have the right place. 

19 If you ruin something, you 

organize It wreck it /collect it 

20 Beware means be 

afraid careful bold 

21 If someone is very rude to you, you are 
insulted amused gratified 

22 To be ready Is to be 

late prepared started 

23 Something which occurs 

wins happens hides 

24 A careless person is 

thoughtless worried neglected 

25 To make something is to 

produce It cancel it imagine It 

26 To injure is to 

take it get well do harm 

27 A person who sees something happen Is a 
reporter speculator -witness, 

28 If you stop for a while, you 
retreat pause leave 

29 A place where grain Is ground Is a 
silo mill factory 



30 To brag Is to be 
boastful cruel 



shy 



31 The girl who does about as well as 
everyone else is 

unusual average special 



32 A' piece of work to be done ts a 



punishment 



force 



task 



Stanford Achievement Test Primary Level II Battery 



TEST I: Vocabulary (Continued) 

33 If ,you keep something from happening, you 
invent it prevent it accept it 

3k Success in a contest is a 

destruction failure victory 

35 Another word for purchase is 

buy lose sell 

36 Land that will grow nothing is 

fertile barren productive 

37 A. pi ace to keep dogs is a 

kennel cave fence 

Ten seconds after reading the last item, SAY: 

STOPi Put your perTci down . Close your book 
let so that tHe picture on the cover is on 
top. 

Give the children a rest period of from five to 
fifteen minutes; then continue with the directi 
•or Test 2: Reading, Part A. 

Second Testing Period 
TEST 2: Reading ~ Part A 
;AY to the pupils: 



Now open your booklet 
Fold the cover back, 1 
page 3 is showing. 



again and 
ike this. 



turn to 
so that 



page3 
only 



>emonstrate 
ihe correct 



Make sure that a1 1 
page. THEN SAY: 



chi Idren have 



We are going to look at some pictures and 
find the words that tell what each picture Is 
Look at the sample at the top left-hand side 
of the page. Put your finger on the picture 
of the apple. 

Point to the sample in your booklet. 



Notice that there are three 
below the picture. You are 
under the one word in each line 
the picture. In each line there are 
words. One of these words tells you 
about the pidture of the apple. Mark 
under the right word. Read the words 
self while I read them aloud 
words are -'this, mi Ik, apple.** 
wha*; the picture is about? 



Vocabulary—Reading Part A Form A 

Yes, the last word,**apple.*' The space under it 
has been marked. 
.Now put your finger on the next line,B. The words 
are **eat, cat, each.** Which word tells something 
about the picture of the apple? 

Pause. 

Yes, the first word,**eat,**so mark the space under 
the word **eat.** 

Now put your finger on the next 1ine,C. The words 
are **f lour, foot, fruit.** Which word tells somethin 
about the picture? 

Pause. 

Yes, the third word,!iLrui t^**so mark the space 
under the word **fruit^** ^' 

You will mark your answers for all the other pic- 
tures on this page and the next page in the same 
way. Mark the §pace*uhder the word in each line 
that tells what the picture ts-^about. 



Does everyone know what to do with the words and 
t)n pictures? First look at the picture. Then look at 
the words under the picture and read them to your 
self. Do not say the words aloud. In each lln^, 
find the one word that tells what the picture in 
the box is about, and mark the space under the 
word. Begin with the picture in the next box and 
go down the column. When you finish this column,^ 
go to the right-hand column. Work down the page 
1 i ke this. 

Point to your own booklet.. 

When you finish this page, turn it over and fold 
it back and go on to the next page, page 4. Keep 
working until you come to the bottom of page 4, 
where it says**STbP.** Then put your pencil down 
and wait. 

Demonstrate, and point to the word **STOP.'* 

If you are not sure which word tells what the 
picture is about, do the best you can. Do you 
have any questions about what you are to do? 



Pause < 



1 ines of words 
to mark the space 
that goes wit| 
three 
somethin 
the spac<i 
to your- 
In 1 ine A, the 
Which word tel Is 



Ready? GO! 

Record the STARTING time on the board or on note 
paper. Give no further help on specific questions 
Walk quietly about the room to find any children 
who do not know how to mark their answers, and 
to make sure that all go on to page k but do not 
turn to page 5. 
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or the class to answer. 
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After 20 minutes, SAY: 



Directions for Administering Reading Part B — 
Word Study Skills Form A 



STOPI *Now write your name at the top of the 
page, where it says "Name.** 

Point to the name blank in your own booklet. 
When all have written their names, SAY: 

Now close your booklet and put your pencil 
down. 



Third Testinq Period 

TEST 2: Reading — Part 8 

SAY to the pupils: 

"Now open your booklet to page 6. Look at the 
top of page 6. Write your name in the box wherie 
it says '^Narne,'^ 

Be sure that every pupil writes his name, THEN 
SAY: 

Now turn to page 5 and fo»d the pages back, 
like this, so that only page 5 is showing. 

Demonstrate. See that all children have the 
right page. SAY: 

Look at the sample box at the top left-hand 
corner of the page. The samples show you what 
to do on this page and the next two pages. 
The story for Sample A reads: *'We saw a happy 
boy and a sad girl. The girl was—** What the 
girl was doing is named in one of the four 
words just below this part of the story, be- 
side the letter A. The words are: "crying; 
flying, purple, asleep." Which word after the 
letter A tells what the girl was doing? 

Pause. 

Yes, the word is '^crying," so the space under 
"crying** has been marked. 

The next part of the story says, '*but the boy 
was — sick, laughing, hurt, angry.** Which 
word after the letter B finishes the sentence 
correctly? 

Pause. 

Yes, the word "laughing** is. best, so mark the 
space under '*)aughing." 

Check to see that all do this correctly. THEN S|^Y: 

g|^Q>u are going to do the rest by yourself. 



Look at each box and read the sentences. 
Each time you come to a line that starts 
with a number, choose the one word in that 
line that makes the most sense and mark the 
space under it. 

Make sure everyone understands what to do. If 
necessary, explain again. THEN SAY: 

Begin with the next box and go down the 
column. When you finish this column, go 
to the right-hand column. Work down the page 
1 ike this. 



Point to your own booklet. 

When you finish this page, turn to page 6 
and fold the booklet back so that only page6 
is showing. Go' on working until you come 
to the bott3%^of page 6. Then turn your 
booklet over to page 7 and keep on working 
until you come to the bottom, where it 
says "STOP." Then put your pencil down and 
wait. 

Demonstrate, and point to the word '*STOP." 

Do you have any questions about what you 
are to do? 

Pause, 

Ready? GOi 

Record the starting time. Watch carefully to 
see that the children go on to pages 6 and 7 
but do not turn to page 8. If necessary, give 
help in turning to pages 6 and 7« 



^After 25 minutes, SAY: 



STOPI Close your booklet and put your pencil 
down . 



lOO 



Di rectlons , for Administering Word Study Skllls- 
Mathematrcs Concepts Form A 



TEST k: Mathematics Concepts 

SAY to the pupils: 

I am going to give you your booklet* Don't > 
open it or mark on it until I tell you to. 
Today we are going to do some work with 
numbers. Listen carefully to what I teH you 
to do. Do the best you can. " 

Pass out the booklets , making sure that each 
child receives his own. THEN SAY: 

Open your booklet to page 10 and fold the pages 
back, like this, so that only page 10-4s 
showing, ^rite your name at the top of the 
page, where it says "Name." 

Demonstrate. Point to the name blank in your own 
booklet. When all have written their names, SAY: 

Now, in the upper left-hand corner, find the 
sample labeled A. You see some numerals. Find 
the one that stands for the greatest number. 
Which Is it? 

Pause. 

Yes, 5 means more than 3,2,or4, so the space 
under 5 has been marked. 

Now find the sample labeled B. Mark the space 
under the numeral 13* 

Pause. 

Did you mark under the last numeral? It Is 13. 
The others are 3,23,and33. 

Check to see that all have marked the sample cor 

rectly. THEN SAY: 

I will tell you what to mark In each of the 
other boxes. You mark the space under the 
answer that you think Is right. Some will be 
hard, but try to do your best on each one. 

Read each Item number; then read each Item exactl 
as It Is stated. Pause about ten seconds before 
going on to the next Item. 

1 Now move down to the box where It says num* 
ber 1 Jn the upper left-hand corner. What 
numeral should^be In the box that has no- 
thing In It? Mark the space under the 
numeral . 

2 Move down to the next box with the number 2* 
Mark the space under the one that stands 
for the empty set. 

3 Now move down to box 3* Here is a 1 Ine of 
children. The first one Is marked. Mark 
the fourth one. 



itanford Achievement Test Primary Level II Battery 



Mathematics Concepts Form A 



tnd number k and number This a calendar o 
["idy, vrtiich has 31 days. When I tell you to, 
rk the 17th and the 27th days. 

5T Ut. Mathematics Concepts (Continued) 

k First mark the 17th of the month* 

5 Now mark the "'27th of the month. 

6 Here you see one quarter, one dime, and 
one nickel. How many cents are they worth 
all together? 

7 Move down to number 7* Here you see some 
sticks which are bundles of tens and a 
few ones. How many sticks are there all 
together? 

bw go up to the top of the next column and fiild 
tnber 8. 

siire e^veryone has the right place. 

8 Which number is one more than one hundred 
ninety-nine? Mark under the number that^ i£ 
one more than one hundred ninety-nine. 

9 Which one of the four sets is equal to the 
set above the line? The words in the set 
above the line are "cup, spoon, fork." 

1 10 Which circle has three dots on it? 
U Now move down to number 11. Mark the num- 
ber that shows Jiow many «^ months there are 
in a year. 

1 12 Which of these numer€LLs means six tens anc 
four ones? 

~i3~Which letter is made only of line segments 
lU Mark the number name of the one that has 

the greatest value. 
15 Here are four sets of circles, squares, & 

triangles. In which set is the number of 

squares greatest? 
I l6 Think of the number 3. Now add to it zero 

Your answer will be-one more-one less-zerc 

or the same? Mark under the answer* 

17 If n is a number and k is a number, then 
n plus k equals k plus what number? Mark 
under that number.' 

Now turn your booklet over to page 11. Find 
number l8 at the top of the page. 

Demonstrate. See that everyone has the right 
place. 
THEN SAY: 

18 This was one set of dots. Then three were 
separated from the set. Which sentence 
tells what happened? 

19 Move down to number 19. One of these four 
numbers comes between 89 and 199 . Mark 
under the number. 
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20 Move down to number 20. Which is lightest? 
The ball is heavier than the book. The 
book is heavier than the box. Mark under 
the lightest one. 

21 Which number is one less than one hundred 
fifty? Mark under the number that is one 
less than one hundred fifty. 

-22 You know that 6 minus (take away) k equals 
2, if ... if what? If 2 plus h equals k 
plus 2 , 2 plus k equals 6, 6 plus 2 equals 
8 , or U minus 2 equals 2. Mark xmder the 
one that is tnie, if 6 minus k equals 2. 
23 A number is in the box. Mark a simple name 

for the number in the box. 
2k Number 2k reads: "Three hundred nine equals 
— ." Mark the number. 

25 Mark the one which is not divided into four 
equal parts. 

26 Which of these numerals is four hundred sev- 
enty-three? 

Now go to number 27 at the top of the next column. 

27 The picture at the top shows a round piece 
of paper which was folded twice, once in thi 
middle and then in the middle again; then 
a piece was cut out. How will the paper 
look when it is unfolded7^rk under the 
paper that shows how it wiil look when it 
is unfolded. ' 

28 Move down to number 28. This is a number 
series. Dicover how the numbers go. Then 
mark the two numbers that belong in the 
frames. Mark only one circle. 

29 The letter A is under what number on this 
number line? 

Look at the chart for numbers 30 and 31. It 
shows how many games four teams have won. 

30 Who won the most games? 

31 The Lions have won how mar^ more games 
than the Seeds. 

32 Which one of these numerals is five hundred 
ninety-six? 

33 Which one of these is an odd number? 

^k You know that 5 minus (take away) 3 eqipls 

2, if... if what? If 3 plus 2 equals 2 plus 

3, 2 plus 3 equals 5, 5 plus 3 equals 8, 

or 5 plus 2 equals 7* Mark under the one th« 
is true, if 5 minus 3 equals 2. 
35 Mark th^simple name for this sentence. 

Ten second^Cfter the last item has been read 
SAY: 

STOP I Put your pencil down and close your 
booklet . 

Give the children a rest period of from five to 
fifteen minutes i then continue with directions 
for Test 5 J Mathematics Computation. 



EST 3' Mathematics Computation 

AY -fco the pupils: 

*Now open your l?ooklet again and turn to page 
ik. Write your name at the top of the page 
where it says "Name." 

monstrate. When all have done this, SAY: 
Now turn to page 12 and fold the pages back, 
like this. *Write your name again at the top 
of this page where it says "Name." 

e sure that all have the correct page, 
en the children have written their names 
AY: 

„Lopk_at the sample marked A in the upper 
left-hand corner. It says; "3 plxis 1 equals-" 
what? Your choices are 3,'*,5>2, or NH, which 
means Not Here; What is the answer? What' 
equals 3 plus 1? 

ause. t-^ 

Yes, 3 plus 1 equals ky so the space under 

the k has been marked, 
^^ow go down to Sample B 
%dnus (take away) 2 equals 1?" 

the answer. 



It says: "What number 
Mark under 



ause. ^ 
Three minus 2 equals 1, so you should mark 
under^^he 3. Does everyone understand what 
to do? Let's try Sample C. Read the problem 
to yourself and then mark under your answer. 

Pause. 

Two plus 3 plus 1 equals what number? Yes, 6, 
but there is no 6 in your choices, so you 
should mark under the NH for Not Here. 

Make sure there are no questions about marking 
answers. THEN SAY: 

You will work problems 1 through 29 the same 
way we have done these samples. When you have 
finished page 12, turn your booklet^ over to 
page 13 and keep on working. Then turn to 
page ik and do the first column of page ik. 
When you have finished problems 29 and come 
to the "STOP" at the bottom of the first 
column, put your pencil down and wait for me 
to give you directions. Do not go to the next 
column until I tell you to do so. Does 
everyone understand what to do? 

Pause. 
Ready? Go I 



Record the STARTING time. 



Watch to see that 



Directions for Administering Mathematics 
Computations Form A 

the children go on to pages 13 and ik but 
not begin the second column on page ik. 



do 



® 



After 20 minutes, SAY: 



STOP! Put your pencil down and listen carefully 
while I tell you what to. do in the second column 
of page ll*. 

Look at the top of the second column. You see 
three signs. The first means "is greater than," 
the second means "is less than," and the third 
means "is equal to." 

Write the three signs and their meanings on the 
board. THEN SAY: 

Does everyone understand what these three signs 
mean? 

Pause. 

In this part of the test, you will mark the 
space tmder the sign that makes the number 
sentence true. Look at Saii5)le A. Is 5 greater 
than, less than, or equal to 3 plxis 1? 

Pause. 

Yes, 5 is greaterthan 3 pltis 1, so the space 
under the sign that means "is greater than" 
has been marked. Now look at Sample B. I^ k 
greater than, less than, or equal to 2 plus 3? 
Mark under the sign that makes the number 
sentence tmie. 



Pause. 

Did everyone mark under the sign that means 
"is less than"? Good, k is less than 2 plus 
"Now try -Sample C and mark your answer. 



3. 



Pause. 

The sign for "is equal to" makes this sentence 
true. 

Point to it on the board. 
Does everyone understand what to do on this part 
of the page? 

Answer any questions. THEN SAY: 
You are to do questions 30 through 37 the same 
way we did these samples. 



Ready? Go I 

Record the STARTING time. 
After 10 minutes, SAY: 

STOP! Put your pencil down 
let. 



and close your book- 



Collect the test booklets immediately. 
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Piers-Harris Self-Concept Scale 



The following charts were taken from: 

^mu"^■'■, ^""l Piers-Harris Children's Self-Concept Scale 
(The Way I Peel About Myself) prepared by Ellen V. Piers ' 

^ published by Counselor Recordings 

and Tests 

Box 6l8i| Acklen Station 
Nashville, Tennessee 37212 
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V:- 



ReTlabllity 

Most of the reliability data come from the original standarization s 
which used the 95 item scale (see table 1). , 



, Internal consistancy. To judge the homogeneity of the test, the Kruder- 
Richardson Formula 21, which assumes equal difficulty flf items, was employed 
with resulting coefficients ranging from .78 to .93. This formula, which is 
represented to be an underestimate as compared with Formula 20, reflects 
the size of the standard deviation, with the resultant lowering of the estimate 
for tenth-grade girls. As a check, the Spearman-Brown odd-even formula was 
applied for half the- Grade 6 and Grade 10 sample, with resulting coefficients 
of .90 and .87, respectively. 

^' TABLE 1 ■ . 

Reliability Data 



Grade Sex • N 



Index 



Coefficients 



Pennsylvania Public 
Schools (Piers & harris, 
1964; 95 items) 



Oregon Public Schools 
(Wing, 1966; 80 items) 



3 


Girls 


56 


Kruder-Richardson 


.90 


3 


Boys 


63 




.93 


6 


Girls 


56 


1 . " 


.89 


6> 


BoyO 


n 


■ M 


;90 


10 


Girl? 


53 


it M 


.78 


10 


Boys 


64 


M M 


.88 


6 


Hoth 


63 


Spearman-Brown 


.90 


10 


Both 


58 


ti It 


.87 


3 


Both 


56 


4 month test-retest 


.72 


6 


Both 


66 




.71 


10 


Both 


: §0 




.72 


5 


Both 


244 


2 4 4 month test-retest 


.77 



Stability. A retest after four months on one half the standardization sample 
resulted in coefficients of .72, .71, and .72, which were judged satisfactory for 
a personality instrument in the experimental stage over so long a period of time. 
The revised 80-i tern scale, though shorter, was shown to have a better reliability 
since Wing (1966) found for both a two-month and four-month test-retest coeffic- 
ients of .77 for 244 fifth graders. It should be remembered that test-retest relia 
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TABLE 2 

Concurrent Validities and Rating Correspondence 





AgQ or 
Orade 


N 


bex 


Mayer (1965) 


12-16 vrs 




Dorn 


Cox (1966) 


grade 6-9 


97 


Both 




" 6-9 


97 


Both 


Piers (1965) 


grade 4 


54 


Boys 




" 4 


57 


Girls 




o 


Oo 


Boys 




" 6 


55 


Girls 




" 4 


54 


Boys 




" 4 


57 


Girls 




" 6 


58 


Boys 




" 6 


55 


Girls 


Cox (1966) 


grade 6-9 


97 


Both 




grade 6-9 


97 


Both 



Pearson r with 
Measure pjers-Harris total 
score 



Lipsitt Children's .68** 
Self-Concept Scale 

Health Problems -.48** 
Big Problems on SR A -.64** 
Junior Inventory 



Teacher Rating . 06 

.41** 
.25 
.17 

Peer Rating .26 

.41** 
.49** 
.34* 



H H 

11 fi 



(I II 
II M 
II M 



Socially effective behavior 

Teacher rating *43** 
Peer rating •SI** 

Superego strength 

Teacher rating .40** 
Peer rating .42** 



* p <-05 
** p ^.01 
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TABLE 3 



School Age Norms (Grades 4 through 12) 
(N=1138) 





Piers-Harris 






Plers-Harrls 






Raw Score 


Percentile 


Stanlne 


Raw Score 


Percentile 


Stanlne 


80 






44 


27 


4 


79 






43 


24 


4 


78 






42 


23 


.3 


77 






41 


21 


3 


76 


99 




40 


20 


3 


75 


98 




39 


18 


3 


74 


97 


9 


38 


17 


3 


73 


96 


8 


37 ' 


15 


3 


72 : 


95. 


8 


36 


14 


3 


71 


94 


8 


35 


13 


3 


70 


93 


8 


34 


12 


3 


69 


91 


8 


33 


• 11 


3 


68 


89 


7 




10 


3 


67 


87 


7 


31 


9 


3 


66 


85 


7 


30 


8 


2 


65 


82 


7 


29 


7 


2 


64 


79 


7 


28 


6 


2 


63 


77 


6 


27 


6 


i 


62 


74. 


6 


26 


5 


2 


61 


71 


6 


25^ 


5 


2 


60 


69 


6 


24 


4 


1 


59 


66 


6 


23 


3 




58 


63 


6 


22 


3 




57 


60 


5 


21 


2 




56 


57 


5 


20 


2 


• 


55 


55 


5 


19 


2 




54 


52 


5 


18 


1 




53 


49 


5 


17 






52 


46 


5 


16 






51 


44 


5 


15 






50 


41 


5 


14 






49 


38 


4 


13 






48 


36 


4 


12 






47 


33 


4 


11 






46 


31 


4 


10 






45 


29 


4 









11 
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Meons end Stondord DevioHons for the Plers-Horrls Self Concept Scale 




Somple 



Age or 
Grade 



N 



Small town Pennsylvania . grade 4 
Public School Children 6 
(Millen, J 966) g 

" JO 
" J2 



275 

265 

23] 

22] 

]9I 



Normative Group Total ] 193 



Rurol and Urban Oregon grode 5 
Public Schools (Wing, 1966) 

Small town Pennsylvania grade 4 
Public Schools (Piers, 1965) " 6 

Spokane Public Schools grades 5. 6 
(Eastman, 1965) 



5J0 



]]] 
]13 

36 



Denver Public Schools 
(Guardo, 1966) 



grade 6 n4 



East Pennsylvania School grade 4 
(Farls. 1966) "5 

" 6 

Suburban New York State ]2-]3 yrs 
Special Education Classes ]4 " ' 
(Mayer, ]965) J5 .. 

J6 " 



22] 
2]] 
207 

34 
25 
22 
]7 



Pennsylvania Public School 8-I0.3 yrs 40 
Stutterers (/Vterley. 1967) ]0.3-]2 " ' 39 

North Carolina School Younger beys 7 
for Emotionally Dis- older " 7 

furbed (Borstelman, 1964) 

Economical ly Deprived grades 4, 5, 6 
Schools, Pontiac, Mich. " 4^5^^ 

12 



108 



Mean SD 

47.79 ]5.|9 

55.36 ]3.93 

52.04 ]3.52 

49.67 ]2.36 

■54.56 ]2.05 

51.84 13.87 

59 (median) 10.5 (quartile 
deviation) 

-.60.40 ]].4o 
54.09 12.71 

55. 94 

58.35 13.58 

54.3 

56.2 

52.7 

'55.97 11.5 

51.08 15.' 19 
54.64 11.89 
55 12.78 

56.48 9.15 
55.36 12.40 

50.4 

60 



56.42 
55.69 



12.06 
]].07 



(1956). Correlations were substantial rnnnm 

«>mewhat inflated, due to the L t ttone of I°"f '° "l''' ^'^'^^y 
beled Anxiety and contains items s milar tl f^ T'! °" PJers-Harrfs is la- 
ore also similar inmethod. bl h u i^g |teZ ' ^"'^^ 
ever, that even allowing for the Zrces of IT P^°bakly. {k,w- 
nificantly related. °^ ""'^Jety and s.i^ —ept are sig- 

TABLE 5 

Correlations with Other Measures 




Gra^e N Sex 



Millen (1966) 


4 


275 




6 


265 




8 


231 




10 


221 




12 


191 


Cox (1966) 


6-9 


97 




6-9 


97 



Millen (1966) 



4 
6 
8 
10 
12 




275 

265 

231 

221 

191 



Both Perception ofparents as loving 

vs. refecting 
Both Peer acceptance-rejection 
4-yr. average score 

Both Children's Manifest Anxiety Scale 

la 



H 
N 
tt 



**P < .01 



.56** 
.61** 



-.59** 
-.65** 
-.61** 
-.54** 
-.69** 



scores to be positlve^T; rTa yZ'ter t^' T'l' 

but insofar as the child knows and accepts U • ! M ^^^^ ^'ff^^^"*' 

pected to have it affect not only 1^^! n ^e might be ex- 
tohis feelings about himself fe 'erdl^ Co^^^^^^ T L'^ possibly 

h.s group, self esteem and tested in elV '^ 7";:"' ^""^^ '"o^t o 

|har his Low-High group (low in sere" ^^^^^^ rank order, but 

-gnored their high intelligence as a b^si f ' f ''^ °^'^^'-^) oPParsntly 

beHveen subjective self eLTm^ i^mt:Jlr:2f '''^ ^ 

Table 6 reports correlations b^een the P;pr«-u • 

16 
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TABLE 6 

Correlations with Mec.ures of Intelligence and Achievement 



Grade N Sex 



I.Q. Measure 



Pearsor) r 



Piers-Harris 
(95' items) 

Piers 
(80 items) 



Eastman 



Mayer 
Cox 

Piers-Harris 
(95 items) 

Piers 
(80 items) 



*P .05 
**p < .01 



3 
6 

4 
4 
6 
6 

5&6 

If 
If 
ff 



88 Both 

116 Both 

54 Boys 

57 Girls 

58 Boys 

55 Girls 

36 Both 

It II 



II 
II 



12-16 yrs. 98 Both 
6-9 97 " 



3 
6 

4 
4 
6 
6 



117 Both 
126 " 

54 Boys 

57 Girls 

58 Boys 

55 Girls 



Group 
Group 

Otis 

If 
II 

Wise Full Scale 
Wise Verbal 
Wise Performance 
Wise Full Scale with Factor II 
(Intellectual and School Status) 
Wise Verbal Scale with Factor 11 

Wise & Binet Standard Scores 

ealif. TestMent. AAat. 

Achievement Test 



II 
» 
II 
11 



.17 
.25** 

-.04 
.36** 
.27* 
.10 

.23 
.28 
.08 
.43** 

.50** 

.04 

.48** 

.19* 
.32** 

.32* 
.43** 
.38** 
.06 
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Administrator Directions 



Plers-Harrls Self-Concept Scale 

(The Way I Feel About Myself) 

Test Materials 

Administrator directions 

Test Booklets 

Pencils 

Time Requirements 

About 3(K35 minutes are required to administer the scale, but there are no time 
limits. If the group seems restless, a "midway stretch" may be taken after item 
f^40 but should not last more than 2 minutes so that the test continuity will be 
only minimally disrupted. 

Instructions to Administrator 

1. Familiarize yourself with the directions for students and the instrument itself 
In advance of the testing session so that you feel com for table "With it. You wilj 
he reading the statements aloud to the children, so practice using an even, non- 
commltal tone. ^ 

2. Check the conditions of the testing environment e.g. adequate number of chairs, 
comfortable tilting surface, adequate lighting, room temperature, etc. 

3. Be prepared with extra pencils 

A. Before distributing the scale, you should satisfy the children's questions about 
the reasons for their selection by saying the following^ 

4 

"Boys and girls, our school has been asked to participate In a special prolect 
for the Educational Improvement Center. One of the Jobs of the poePle at the 
Educational Improvement Center is to find out about how students feel about 
themselves and some of the things they are doing in school so that we can help 
you learn better and be happier. Many different children in many different 
schools all over New Jersey are helping out with this prelect. Both you and 
the rest of these students were chosen by chance, kind of like picking a name 
out of a hat. 

Today I'm going to ask you to answer some questions that have no right or 
wrong answers. Rather I'm going to ask you to think about how you feel about 
some things that can be different for each person. No one in this Tdhool is 
going to look at your answers. They will be completely private, so I'm going 
to ask you to answer as honestly as you can about your own feelings. 

5. You may now pass out the instruments saying: 
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When you each get a booklet, please fold back the cover page and print (write) 
your name, age, a G or B for Girl or Boy, your grade (or unit), the name of our 
school and the date which is 



Allow sufficient time for this, walking around the room to check on their accuracy. 
Continue saying: 

Please turn the booklets over to page one and I will read the instructions with you. 
(Read paragraph on top of page one of instrument) 

6. Be certain that all the children understand that they must answer either "yes or 
"no" for all items. There should be no omissions and no double circles, even if 
some items are hard to decide. 

7. As you read the items, it would be wise to walk around the room in an unobtrusive 
manner to make sure the children are making the items correctly. You should also 
check periodically to be sure they are all on the correct number, (e.g. "Are we 
all on #7?") ^ 

8. The examiner should read each item clearly twice without haste, but not so slowly 
that second thoughts or distraction will occur. After a few items, the examiner 
can usually determine the optimal pace for that group. 

9. One or two words in the scale may be difficult for some children (e.g. "unpopular") 
but have been retained in the form to eliminate a double negative. These may be 
defined. It is also permissible to answer one or two questions at the beginning, 
particularly with reference to the all-or-none quality of the items. It should be 
explained that it is recognized that everyone feels differently at different times 
in different situations, but that they should mark the item the way they generally 
feel . 

Additional questions are usually unnecessary and should be discouraged. 
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Random Sampling Procedure 
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Prooedures to be follow to select a random sanple 
ofstudents to be tested 



We are glad that you have agreed to take part in the New Jereey Ige/MUS-E research/ 
evaluation study. In order to get a r^resentative picture of student attitudes and 
achievQBent, it is iitportant that you administer the enclosed instnitents to a randan 
sanple of students. 

The procedure to be used in selecting this saitple is outlined below: 
Background; 

St^^pose that you have a limited popluatic»i f ran \itiLdci you wish to draw a random 
sanple of "n" individuals. Qr^ method of doing this would be to assign a nuitoer to 
eadi menter of the peculation, put a set of numbered tags corre^nding to the 
individuals into a box, and draw "n** tags from the box. Ttie nuiiDers on these "n" 
tags will correspond to the individuals to be selected. Hiis is a satisfactory 
method except for the labor involved. 

We can shorten this process by use of a table of randoro nurttoers. (table is appended) 
Use of table of rancJom nunobers: 

1. C±>tain a roster of students v4k) are in second and third grades or in their 
second and third year of school beyond kindergarten. 

2. Niirber the names (from 1,2,3.. .n) 

3. Enter the random nui±>ers table at a fandom point and proceed 

4. Use the oarputer generated random nitrBers table ^jpended to select 

a. one sample of second graders of size and 3 alternates 

b. one sample of third graders of sItc and 3 alternates 



This procedure should be implanented twice; once to identify the second grade sanple 
and then to select the third grade sample. 

Before proceeding further, please read the exanple below vMch will undoubtedly clarify 
the whole procedure. 

Example; ^ 

Let's say that you wish to select a random sanple of 20 students from a total population 
of 400 students. First, assign consecutive nurtDers (l,2,3,...n) Looking at the random 
numbers table, you will see columns of five-digit nurtoers, however you will only be 
dealing with the first three digits of each randan nurber ccKbination. Begin by 
entering the table any\^iere. Three-place nunbers are needed so we use three digits 
per coliiTn in the random nunbers table. If the first nuiber you locate in the table 
is 400 or less, take the corresponding student nuniDer from the roster as the first 
student in the sample. Continue in this manner, moving from top to bottom in the 
table, until 20 students have been identified. Skip nunbers over 400. If a nunter 
appears twice, skip it the second time. 
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Evaluation Design 
IGE - New Careers in Education 



GOAL 1 



Goal: As a result of state network implementation by the New Careers 
in Education Office, first and second cycle elementary schools 
meeting minimum IGE implementation criteria will produce sig- 
nificant changes in student learning. 



1.1 In comparison with children in control groups, students 

in IGE classrooms will show significantly greater achieve- 
ment in rjading and/or?math aS} measured by a standardized 
achievem^t test. (Reading atfd/or math will be measured 
as appropriate to the implementation process in the specific 
school s'iii»'..the study.) 



Performance to be Measured 

Student achievement in reading and/or math. 



Selection of Participants 

A random sample of schools will be drawn from those first and second cylcle IGE 
schools that are implementing reading and/or math within the MUS-E design. 
Students will be sampled within the identified schools, A matched sample of 
students not attending an IGE school will be drawn to serve as a control ^group 
for the- purposes of this study. 



Measurement Instruments and Data Collection Procedures 

Appropri^e batteries of the Stanford Achievement Tests, 1973 edition, will be 
^ used to niasure achievement in reading and/or math. (The subject area will be 
determined by the implementation process in each school in the study*) The 
students in both the IGE and ^:he control groups will be tested in February, 1974, 
to allow for maximum exposure to the IGE/non-IGE experience. 



Data Analysis Techniques 

. Scores frgm IGE and control schools Ue analyzed with a i-test for differences 
between means, A second level anali^is^ill be accomplished, using the judgments 
of IGE facilitators, to compare (^ferences between schools thaft are highly 
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successful in implementing IGE procedures with those that are not. Non- 
parametric statistics will be used to analyze these differences, A 0,05 
level of significance will be utilized* 



1,2 In comparison with children in control groups, students 
in IGE classes will demonstrate significantly more 
positive attitudes toward school. 



Performance to be Measured 
Student attitude toward school. 



Selection of Participants 

The same IGE and control populations that participate in the reading/math 
achievement testing (indicator 1.1) will participate in this aspect of the 
design* 



Measurement Instruments and Data Collection Procedures 

A RETE- developed instrument, ATCA, will be administered to measure any dif- 
ferences between students in IGE and control schools with respect to their 
attitudes toward school. The ATCA was adapted from work done at the Institute 
for Educational Research, Downers Grove, Illinois, (See Appendix.) 



Data Analysis Techniques 

Total scores will be analyzed a t-test for differences between means.* A 0.05 
level of significance will be utilized. 



Person(s) Responsible For Evaluation 

Research Evaluation Team for Education (RETE), Dr. Karen Todd, Director. 
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GOAL II 



Goal: As a result of state network i'mpleiiientation by the New Careers 
in Education Office, first and secQTSd cycle elementary schools 
meeting minimum IGE implementation criteria will show character- 
istics which are likely to facilitate long-term commitment to 
the IGE process* 



2J Expenditures will show no significant increase for start 
up and maintenance costs. 



Performance to be Measured 

Amount and use of those funds available to the building principal of an IGE- 
MUS-E school, (i.e., whether the school, functioning within the IGE-MUS-E 
design is actually more costly to operate, or whether only a redistribution 
of monies is required. Areas under question will include hiring of para- 
professionals, unit leader compensation, released time for teachers, and in- 
structional materials.) 



Selection of Participants 

AJl first and; second cycle IGE schools as identified by the New Careers in 
Education Office. 



Measurement Instruments and Data Collection Procedures 

A data collection form wilKbe mailed to each IGE building principal asking 
him/her to identify cost items such as those listed above as they relate to 
currqnt expenses and expenses for the one year prior to IGE implementation. 
The ifnstrument will be mailed to principals in spring, 1974, to allow for 
inclusion of ^ata from the current academic year. 



Data?Analys1s Techniques 

Each item of the survey will be analyzed and tabulated. Descriptive statistics 
will be used to report findings. 



Person(s) Responsible for Evaluation 
♦ 

Research Evaluation Team for Education (RETE), Dr. Karen Todd, Director. 
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2.2 Pupil absenteeism will show no significant increase from 
previous years. 



Performance to be Measured 

Pupil absenteeism in first and second cycle IGE schools. 
Selection of Participants 

Records on student populations from all first and second cycle schools will 
be included. 

Measurement Instruments and Data Collection Procedures 

A data collection form will be mailed to each building principal soliciting 
statistical data relative to pupil absenteeism both presently and prior toiGE 
implementation. The instrument will be mailed to principals in spring, 1974, 
to allow for inclusion^ of data from the current academic year. This form is 
currently under development by RETE. 

Data Analysis Techniques 

Descriptive statistics will be used to report findings. 
Person(s) Responsible for Evaluation 

Research Evaluation Team for Education (RETE), Dr. Karen Todd, Director. 

2.3 Teacher attendance and turnover will show no significant 
change from previous years. 

Performance to be Measured 

Teacher attendance/absenteeism. Incidence of teacher turnover. 
Selection of Participants 

Records for teacher populations from all first and second cycle schools will be 
included. 

Measurement Instruments and Data Collection Procedures 

A data collection form will be mailed to each IGE building principal soliciting . 
statistical data relative to teacher attendance and turnover both presently and 
in the one year prior to their IGE MUS-E implementation. The instrument will be 
mailed to principals in the late spring, 1974, to allow for inclusion of data 
from the current academic year. 
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Data Analysis Techniques , ' 

Descriptive statistics will be used to report findings. 

Person(s) Responsible, for Evaluation 

Research Evaluation Jeam for Education (RETE), Dr: Karen Todd, Director 

2.4 lea's will be able to assess the effectiveness of the 
I6E progress at the local level. 

Perfonnance to be Measured 

Community support for I6E. Locally selected aspects of the RETE-NCE evaluation 
design. 

Selection of Participants 

Any LEA which is participating in the New Careers - I6E project and has not 
b|e| designated as participating in the RETE-NCE evaluation design. 

Measurement Instruments and Data Collection Procedures 

Names, sources, and background information on instruments RETE will employ, 
as well as in instrumejit appropriate to measurement of community attitudes 
toward I6E, will be included in an evaluation procedures packet. This packet 
will be made available through* the New Careers in Education Office. All or 
part of this packet may be employed by the LEA's at their discretion. 

Data Analysis Techniques 

Analysis techniques employed will be determined by the LEA, with" guidelines 
supplied in the packet. 

Person(s) Responsible for Evaluation 
TO:be determined by the individual LEA's. 
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GOAL MI 



Goal: A system will be developed and operative whereby the implementation 
process of I6E can be monitored and expanded by the New Careers in 
Education Office. 



3.1 75% of IGE league members who request assistance from. the 
New Careers in Education Office will indicate that the NCE 
Office did provide assistance that was appropriate to their 
problem. 



Performance to be Measured 

Assistance provided by the New Careers in Education Office to IGE league members. 



Selection of Participants 

All members of the IGE leagues will be asked to provide feedback data with re- 
spect to assistance received from the New Careers in Education Office. 



Measurement Instruments and Data Collection Procedures 

A data collection form developed by RETE will be used by the NCE Office to ob- 
tain appropriate feedback from league members. 



Data Analysis Techniques 

Descriptive statistics will be used to report findings. 



Person(s) Responsible for Evaluation 




Designated personnel ip the New Careers in Education Office 



3.2 80% of the areas of concern reported to facilitators and 
recorded on the school visitation summary will be followed 
through by the New Careers in Education Office with ap- 
propriate action at the HUB or league level. 



Performance to be Measured 



Response by the New Careers in Education Office to facilitator reports. 
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Selection of Participants 

Personnel in IGE schools who relate their concerns to league facilitators. 

Measurement Instruments and Data Collection Procedures 

School visitation summary forms completed by league facilitators will be 
used to record the concerns communicated to them by IGE school personnel. 
Evidence of action taken will be documented in NCE Office records. 

Data Analysis Techniques 
Descriptive statistics will bemused. 

Person (s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 

3.3 75% of the principals from IGE schools will indicate at least 
three specific examples of how a facilitator helped in the 
implementation of this program. 

Performance to be Measured 

Facilitator assistance to principals of IGE schools with respect to the IGE 
'MUS-E implementation process. 

Selection of Participants 

All principals of IGE schools will be asked to provide examples of facilitator 
assistance in the implementation process. 

Measurement Instruments and Data Collection Procedures 

Feedback forms developed by RETE will be mailed to IGE school principals to 
solicit appropriate feedback information. 

Data Analysis Techniques 
Descriptive statistics will be used. 
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Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 

Each league chairman will be able to indicate at least two 
specific examples of how a HUB meeting helped solve a 
specific problem for him. 

Performance to be Measured 

Effectiveness of HUB meetings as problem-solving vehicles for league chairmen. 
Selection of Participants 

All league chairmen will be asked to provide feedback data on HUB meetings. 
Measurement Instruments and Data Collection Procedures 

A data collection form developed by RETE will be used by the NCE Office to solicit 
appropriate feedback from league chairmen, following HUB meetings. 

Data Analysis Techniques 

Descriptive statistics will be used to report findings. 
Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 
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GOAL IV 



Goal: 100% of the 15 third cycle school districts undergoing a clinical 
training approach will meet minimum IGE implementation criteria 
June, 1975. 

4.1 By October 30, 1973, at least 15 school districts will re- 
quest to take part in a pre-clinical workshop. 



Performance to be Measured 

Number of school districts requesting to participate in a pre-clinical workshop. 



Selection of Participants 

N.J. school districts that select themselves by requesting to participate. 



Measurement Instruments and Data Collection Procedures 

Records of request coming into the New Careers in Education Office. 



Data Analysis Techniques 

Total number of requests will be reported. 



Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. . 



4.2 By December 31, 1973, at least 15 school districts will 
have submitted a formal application with documentation 
evidence and will have met the standards of the New 
Careers in Education Office for IGE participation. 



Performa nce to be Measured 

Number of school districts submitting iformal application and documentation 
evidence and meeting standards of the New Careers in Education Office for 
IGE participation. 



Selection of Participants 

N.J. school districts that select themselves by following application procedures 
and meeting NCE criteria for IGE participation. 
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Measurement Instruments and Data Collection Procedures 



Records of application procedures and criteria for IGE participation as 
maintained by the NCE Office. 



Data Analysis Techniques 

Total number of applicants who meet minimum criteria will be reported. 



Person(s) Responsible for Evaluation 

.Designated personnel in the New Careers in Education Office. 



4.3 By the end of the clinical workshop, 100% of the principals 
and unit leaders will score 80% or higher on a test of IGE 
knowledge and skills. 



Performance to be Measured 

Knowledge of IGE application and skills. 



Selection of Participants 

Principals and unit leaders identified by their respective school districts to 
participate in a clinical workshop. 



Measurement Instrument and Data Collection Procedures 

The IGE Concepts Test by Mary Quilling and Juanita Sorenson from the 
Wisconsin Research and Development Center for Cognitive Planning will be 
administered by personnel from the New Careers in Education Office* 
Each section of the instrument will be used to ascertain knowledge acquired 
during a corresponding module of the ten day clinical workshop. 



Data Analysis Techniques 

Subtest scores for each workshop participant will be totaled to determine the 
level of mastery achieved by each principal and unit leader, and the percentage 
of correct answers will be calculated. The percent of participants who score 
80% or higher will be determined. 



Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 
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4.4 By the end of their clinical experience, all participating 
schools win have met the first two criteria for an IGE 
school and will have evidence that they are working toward 
the third criterion. 



Performance to be Measured 

Satisfaction of criteria as a Multi-Unit School (MUS-E) on the organizational 
level, including a functioning Instructional Improvement Committee (IIC). 
Evidence of movement toward implementing IGE in at Ieas3:j6ne subject area. 



Selection of Participants 

Schools whose personnel have participated in the clinical workshop. 



Measurement Instruments and Data Collection Procedures 

Facilitator school visitation summaries and observations will be used to 
validate the schools* satisfaction of the above stated conditions. 



Data Analysis Techniques 
Descriptive statistics will be used. 



Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 
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GOAL V 



Goal: By June 1975, seven middle schools will meet minimum IGE 
implementation criteria. 



5.1 By July 1, 1973 at least seven middle schools will 
request to take part in a pre-clinical workshop. 




Performance to be Measured 

Number of school districts requesting to participate in a pre-clinical workshop. 
Selection of Participants 

N.J. school districts that select themselves by .requesting to participate. 

Measurement Instruments and Data Collection Procedures 

Records of requests coming into the New Careers in Education Office. 

Data Analysis Techniques 

Total number of requests will be reported. 

Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 



Performance to be Measured 

Number of school districts submitting formal application and documentation 
evidence and meeting standards of the New Careers in Education Office for 
IGE participation. 

Selection of Participants 

N.J. school districts that select themselves by following application procedures 
and meeting NCE criteria for IGE participation. 

Measurement Instruments and Data Collection Procedures 

Records of application procedures and criteria for IGE participation as 
maintained by NCE Office, 



5.2 By September 30, 1973 at least seven middle schools will 
have submitted a formal application with documentation 
evidence, and will have met the standards of the New 
Careers in Education Office for IGE participation. 
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5.3 



By the end of their clinical workshop, 100% of the principals 
and unit leaders will score 80% or higher on a test of I6E 
knowledge of application and skills. 



Perfonnance to be Measured 

Knowledge of IGE application and skills. 

Selection of Participants 

Principals and unit leaders identified by their respective school districts to 
participate in a clinical workshop. 

Measurement Instruments and Data Collection. Procedures 

The IGE Concepts Test by Mary Quilling and Juanita Sorenson from the 
Wisconsin Research and Development Center for Cognitive Learning, adapted by 
RETE for use with middle schools, will be administered by personnel from the 
New Careers in Education Office. Each section of the instrument will be used 
to ascertain knowledge acquired during a corresponding module of the ten day 



Data Analysis Techniques 

Subtest scores for each workshop participant will be totaled to determine the 
level of mastery achieved by each principal and unit leader and percent of 
mastery will be calculated. The percent of participants scoring at the 80% 
level or above will be calculated. 



Person(s) Responsible for Evaluation 

Designated personnel from the New Careers in Education Office. 



5,4 By the end of their clinical experience, all participating 
schools will have met the first two criteria for an IGE 
school and will have evidence that they are working toward 
the third criterion. 



Performance to be Measured 

Satisfaction of criteria as a Multi-Unit School (MUS-E) on the organizational 
level, including a functioning Program Improvement Council (PIC). Evidence 
of movement toward implementing IGE in at leastSone subject area. 

Selection of Participants 

Schools whose personnel have participated in the clinical workshop. 
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Measurement Instruments and Data Collection Procedures 

Facilitator school visitation summaries and observations will be used to 
validate the schools' satisfaction of the above stated conditions. 

Data Analysis Techniques 
Descriptive statistics will be , used. 

Person(s) Responsible for Evaluation 

Designated personnel in the New Careers in Education Office. 
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IGE - Appendix 



Attitude Toward Classroom Atmoshpere (ATCA) 

The original instrument of forty Items was developed at the Institute for 
Educational Research, Downers Grove, Illinois. RETE examined the items for 
relevance of content to this project's objectives^. The instrument was then 
piloted with 122 first through fifth graders.' Item analysis, re-examination of 
content, and subjective feedback from examiners were then used to arrive at 
the present thirty item form. Two answer forms were designed to simplify test 
taking procedures: a primary fonfi for use wit|i^ first through third graders, 
and an elementary form for use with f ourthJand ^#i f th graders. A standard set 
of directions for administration were also developed. 

The reliability of the ATCA will be studied using both split-half and test- 
retest correlations. A measure of the instrument's concurrent validity will be 
obtained as follows: ^ 

a. use of the ATCA with groups receiving different experimental 
treatment and comparison of the resulting scores, 

b. comparison of actual scores with observational ratings sub- 
mitted by ^valuators. 

c. correlation of .ATCA scores with scores obtained by the same 
group on the "Creativity Attitude Survey," ' , 

d. correlation of ATCA scores with scores obtained by^ the same 
group on the "at school" dimension of the "Satisfaction of 
Values Inventory." 



Stanford Achievement Test , Form A, 1973 edition. (Harcourt Brace Jovanovich, Inc.) 

This latest edition of the Stanford Achievement Test includes six battery levels 
spanning elementary and junior high school. According to the publishers, a major 
goal of the revision was "to make sure that the content of the test would be in 
harmony with present instructional objectives and measure what is actually taught 
in today's schools." Selection of the Stanford Achievement Test as the cognitive 
measure for this project evaluation was based on the depth of the work done in 
test construction and development, a complete description of which may be found 
in the Norms Booklet accompanying the instrument. Additional consideration was 
given to the fact that none of the schools included in the sample are currently 
using these tests in their testing programs. Finally, the batteries relevant 
to reading and math can be easily isolated as 

Feedback Forms 

The attached forms were developed tn meet the specific needs and procedures of the 
New Careers in Education Office. 
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) Questionnaire - 3x/year - November 15. February 15, May 15 
To principals and U. L. ? " -^^ iviay 

1. How often are you in contact with your league facilitator? 

2. When was your most recent contact with him/her? 

^' .M'ff i'""^" °i T'''^''' in^Plomentation assistance have you or vour 
staff received from your IGE facilitator? ^ 

1. 



2. 



3. 



4. 



5. 
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Objective 3. 4 
N'CE/IGE 



To be filled out by league chairman following each HUB meeting: 
League Chairman 



1. Please indicate specific problems you had prior to this HUB meeting, 
that were dealt with by this group. "<-t.ung. 



1. 



2. 



3. 



^* ?ii^'^^^^'^T'''^^^^Py^^^olva these pM^^ Ifyes-hoW^ 
(Please be specific and concise.) 



1. 



2. 



3. 
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